2601.16390

Total: 1

#1 Cross-Lingual Activation Steering for Multilingual Language Models [PDF] [Copy] [Kimi2] [REL]

Authors: Rhitabrat Pokharel, Ameeta Agrawal, Tanay Nagar

Large language models exhibit strong multilingual capabilities, yet significant performance gaps persist between dominant and non-dominant languages. Prior work attributes this gap to imbalances between shared and language-specific neurons in multilingual representations. We propose Cross-Lingual Activation Steering (CLAS), a training-free inference-time intervention that selectively modulates neuron activations. We evaluate CLAS on classification and generation benchmarks, achieving average improvements of 2.3% (Acc.) and 3.4% (F1) respectively, while maintaining high-resource language performance. We discover that effective transfer operates through functional divergence rather than strict alignment; performance gains correlate with increased language cluster separation. Our results demonstrate that targeted activation steering can unlock latent multilingual capacity in existing models without modification to model weights.

Subjects: Computation and Language , Artificial Intelligence

Publish: 2026-01-23 01:41:17 UTC