Abstract

This paper presents the HINTT system submitted to the 2nd Challenge and Workshop on Multilingual Conversational Speech Language Model (MLC-SLM). We address multilingual speaker-attributed ASR, where systems must determine who spoke when and what was spoken. We investigate two modeling strategies for this problem: a cascaded pipeline that combines speaker diarization with speech-LLM-based ASR, and a unified speech LLM that directly generates speaker labels, timestamps, and transcriptions. Our final submission is based on the cascaded pipeline, consisting of a fine-tuned DiariZen diarization model, a fine-tuned Qwen3-ASR model, and LLM-based generative error correction. For comparison, we also fine-tune VibeVoice-ASR as a unified model using the same official training data. All task-specific fine-tuning and model selection are performed using only the official MLC-SLM data, without external data or pseudo-labels. Experimental results demonstrate that the cascaded system remains more reliable under the MLC-SLM Task 1 conditions, while unified speech LLMs offer a promising direction for future speaker-attributed ASR.

Keywords

Publication details

Journal
Not available
Open access
Green open access

Cite this article

APA 7

Ashihara, T., Matsuura, K., & Mimura, M. (2026). HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR. https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr

MLA 9

Ashihara, Takanori, et al. "HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR." https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr.

Chicago (author–date)

Ashihara, Takanori, Kohei Matsuura, and Masato Mimura. 2026. "HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR." https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr.

Harvard

Ashihara, T., Matsuura, K. and Mimura, M. (2026) 'HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR', Available at: https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr.

Vancouver

Ashihara T, Matsuura K, Mimura M. HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR. https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr

IEEE

T. Ashihara, K. Matsuura, and M. Mimura, "HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASR," https://omanscience.com/en/articles/hintt-submission-to-the-2nd-mlc-slm-challenge-comparing-cascaded-and-unified-approaches-to-diarization-and-asr.