Abstract
Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency trade-offs are underexplored. We benchmark eleven systems, ten open-weight models and one commercial API, across five Iberian languages (Basque, Catalan, Galician, Portuguese, Spanish), with German and Turkish as controls. Evaluation uses an 85-hour dataset covering read speech, broadcast media, and audiobooks, assessing accuracy and efficiency via word error rate (WER) and real-time factors (RTF/RTFx). Results show no single model dominates: accuracy, efficiency, and language coverage present clear trade-offs. Low-resource languages, especially Basque, degrade significantly, highlighting the role of training coverage. We observe consistent sex disparities across most systems, highlighting fairness challenges in multilingual ASR. Overall, the benchmark provides practical guidance for real-world model selection.
Keywords
Subject
Publication details
- Journal
- Not available
- Open access
- Green open access
Cite this article
APA 7
López, F., Gómez, P., Solans, D., Villegas, P., & Luque, J. (2026). Benchmarking Automatic Speech Recognition Tools for Iberian Languages. https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages
MLA 9
López, Fernando, et al. "Benchmarking Automatic Speech Recognition Tools for Iberian Languages." https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages.
Chicago (author–date)
López, Fernando, Pablo Gómez, David Solans, Paulo Villegas, and Jordi Luque. 2026. "Benchmarking Automatic Speech Recognition Tools for Iberian Languages." https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages.
Harvard
López, F., Gómez, P., Solans, D., Villegas, P. and Luque, J. (2026) 'Benchmarking Automatic Speech Recognition Tools for Iberian Languages', Available at: https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages.
Vancouver
López F, Gómez P, Solans D, Villegas P, Luque J. Benchmarking Automatic Speech Recognition Tools for Iberian Languages. https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages
IEEE
F. López, P. Gómez, D. Solans, P. Villegas, and J. Luque, "Benchmarking Automatic Speech Recognition Tools for Iberian Languages," https://omanscience.com/en/articles/benchmarking-automatic-speech-recognition-tools-for-iberian-languages.