2601.18899

Total: 1

#1 Language Family Matters: Evaluating LLM-Based ASR Across Linguistic Boundaries [PDF1] [Copy] [Kimi1] [REL]

Authors: Yuchen Zhang, Ravi Shekhar, Haralambos Mouratidis

Large Language Model (LLM)-powered Automatic Speech Recognition (ASR) systems achieve strong performance with limited resources by linking a frozen speech encoder to a pretrained LLM via a lightweight connector. Prior work trains a separate connector per language, overlooking linguistic relatedness. We propose an efficient and novel connector-sharing strategy based on linguistic family membership, enabling one connector per family, and empirically validate its effectiveness across two multilingual LLMs and two real-world corpora spanning curated and crowd-sourced speech. Our results show that family-based connectors reduce parameter count while improving generalization across domains, offering a practical and scalable strategy for multilingual ASR deployment.

Subjects: Computation and Language , Artificial Intelligence , Sound

Publish: 2026-01-26 19:11:03 UTC