2503.04710

Total: 1

#1 Self-Supervised Models for Phoneme Recognition: Applications in Children's Speech for Reading Learning [PDF1] [Copy] [Kimi3] [REL]

Authors: Lucas Block Medin, Thomas Pellegrini, Lucile Gelin

Child speech recognition is still an underdeveloped area of research due to the lack of data (especially on non-English languages) and the specific difficulties of this task. Having explored various architectures for child speech recognition in previous work, in this article we tackle recent self-supervised models. We first compare wav2vec 2.0, HuBERT and WavLM models adapted to phoneme recognition in French child speech, and continue our experiments with the best of them, WavLM base+. We then further adapt it by unfreezing its transformer blocks during fine-tuning on child speech, which greatly improves its performance and makes it significantly outperform our base model, a Transformer+CTC. Finally, we study in detail the behaviour of these two models under the real conditions of our application, and show that WavLM base+ is more robust to various reading tasks and noise levels. Index Terms: speech recognition, child speech, self-supervised learning

Subjects: Sound , Artificial Intelligence , Audio and Speech Processing

Publish: 2025-03-06 18:57:16 UTC