2610.35846

Total: 1

#1 Preserve to Expand: Source-Aware Adaptation and Model Merging for Multilingual LLM-Based ASR [PDF] [Copy] [Kimi] [REL]

Authors: Yuchen Zhang, Haralambos Mouratidis, Ravi Shekhar

Expanding multilingual ASR systems to new languages is challenging when adaptation must preserve previously supported languages without replaying source-language training data. We study this problem in connector-based Speech LLMs, where a trainable connector maps speech representations into a frozen large language model. We evaluate target-update construction and merging strategies for adapting the connector while preserving source-language performance. In single-target expansion, target-only fine-tuning and standard TIES merging learn new languages but cause severe source-language forgetting, while SSU-Wanda+TIES gives the best source-preserving trade-off. In multi-target expansion, update merging provides stable source retention, whereas recursive expansion can improve target adaptation under favorable orders but is highly order-sensitive. These results show that multilingual ASR expansion requires balancing target acquisition, source retention, and interactions among target-language updates.

Subject: Computation and Language

Publish: 2026-10-26 17:56:22 UTC