2606.19910

Total: 1

#1 Light-weight Pronunciation Assessment via Discrete Speech Token Surprisal [PDF] [Copy] [Kimi] [REL]

Authors: Syeda Faiza Ahmed Sara, Shammur Absar Chowdhury

Training automated pronunciation assessment often relies on labeled learner errors or non-native corpora that are costly to collect. We propose a lightweight framework trained only on native speech resources, operating unsupervised or lightly calibrated with a small set of scored utterances. At inference, learner speech is discretized with an SSL encoder and a K-means codebook. A token language model trained on native sequences computes surprisal where higher surprisal indicates phonotactic deviation. We add a transcript-guided Text2DUnit--DTW module that predicts native token sequences from reference text and aligns them to acoustic tokens to derive error-sensitive features. Surprisal and alignment features are fused via simple regression. On SpeechOcean762, PCC improves from 0.60 to 0.66 with transcript guidance, near supervised baselines. Cross-dataset evaluation on L2-ARCTIC shows consistent gains.

Subjects: Computation and Language , Sound , Audio and Speech Processing

Publish: 2026-06-18 08:04:16 UTC