katz14@interspeech_2014@ISCA

Total: 1

#1 Opti-speech: a real-time, 3d visual feedback system for speech training [PDF] [Copy] [Kimi1]

Authors: William Katz ; Thomas F. Campbell ; Jun Wang ; Eric Farrar ; J. Coleman Eubanks ; Arvind Balasubramanian ; Balakrishnan Prabhakaran ; Rob Rennaker

We describe an interactive 3D system to provide talkers with real-time information concerning their tongue and jaw movements during speech. Speech movement is tracked by a magnetometer system (Wave; NDI, Waterloo, Ontario, Canada). A customized interface allows users to view their current tongue position (represented as an avatar consisting of flesh-point markers and a modeled surface) placed in a synchronously moving, transparent head. Subjects receive augmented visual feedback when tongue sensors achieve the correct place of articulation. Preliminary data obtained for a group of adult talkers suggest this system can be used to reliably provide real-time feedback for American English consonant place of articulation targets. Future studies, including tests with communication disordered subjects, are described.