الملخص
English-only benchmarks expose only a narrow slice of voice-agent behavior. We introduce $τ$-Multilingual, extending $τ$-Voice to Spanish, Brazilian Portuguese, Hindi, Korean, and Mandarin with native-speaker review and evaluation of generated language and spoken output. Across 4,500 full-duplex calls and five voice configurations, Spanish, Portuguese, and Hindi remain within 3.2 task-completion points of English, but Korean and Mandarin fall by 14.7 and 8.4 points. The failure modes also vary: Korean systems miss more responses, Mandarin systems interrupt more often, and both struggle with tools and entities. Grok leads task completion but scores lowest on generation quality, motivating separate task, interaction, and generation reporting. We release language packs, validated judges, and tools for community-built multilingual voice-agent evaluation.
الكلمات المفتاحية
الموضوع
بيانات النشر
- المجلة
- غير متاح
- وصول مفتوح
- وصول مفتوح أخضر
اقتبس هذه المقالة
APA 7
Ray, S., Paiva, E. D. S., Valenzuela, R., Narasimhan, K., Dhandhania, K., & Barres, V. (2026). $τ$-Multilingual: Benchmarking Voice Agents Across Languages. https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages
MLA 9
Ray, Soham, et al. "$τ$-Multilingual: Benchmarking Voice Agents Across Languages." https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages.
شيكاغو (المؤلف–التاريخ)
Ray, Soham, Edgard dos Santos Paiva, Ruben Valenzuela, Karthik Narasimhan, Keshav Dhandhania, and Victor Barres. 2026. "$τ$-Multilingual: Benchmarking Voice Agents Across Languages." https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages.
هارفارد
Ray, S., Paiva, E. D. S., Valenzuela, R., Narasimhan, K., Dhandhania, K. and Barres, V. (2026) '$τ$-Multilingual: Benchmarking Voice Agents Across Languages', Available at: https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages.
فانكوفر
Ray S, Paiva EDS, Valenzuela R, Narasimhan K, Dhandhania K, Barres V. $τ$-Multilingual: Benchmarking Voice Agents Across Languages. https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages
IEEE
S. Ray, E. D. S. Paiva, R. Valenzuela, K. Narasimhan, K. Dhandhania, and V. Barres, "$τ$-Multilingual: Benchmarking Voice Agents Across Languages," https://omanscience.com/ar/articles/multilingual-benchmarking-voice-agents-across-languages.