2410.01579

Total: 1

#1 Spoken Grammar Assessment Using LLM [PDF1] [Copy] [Kimi1] [REL]

Authors: Sunil Kumar Kopparapu, Chitralekha Bhat, Ashish Panda

Spoken language assessment (SLA) systems restrict themselves to evaluating the pronunciation and oral fluency of a speaker by analysing the read and spontaneous spoken utterances respectively. The assessment of language grammar or vocabulary is relegated to written language assessment (WLA) systems. Most WLA systems present a set of sentences from a curated finite-size database of sentences thereby making it possible to anticipate the test questions and train oneself. In this paper, we propose a novel end-to-end SLA system to assess language grammar from spoken utterances thus making WLA systems redundant; additionally, we make the assessment largely unteachable by employing a large language model (LLM) to bring in variations in the test. We further demonstrate that a hybrid automatic speech recognition (ASR) with a custom-built language model outperforms the state-of-the-art ASR engine for spoken grammar assessment.

Subjects: Computation and Language , Artificial Intelligence

Publish: 2024-10-02 14:15:13 UTC