10538@AAAI

#1 Integrating Verbal and Nonvebval Input into a Dynamic Response Spoken Dialogue System [PDF] [Copy] [Kimi]

Authors: Ting-Yao Hu ; Chirag Raman ; Salvador Medina Maza ; Liangke Gui ; Tadas Baltrusaitis ; Robert Frederking ; Louis-Philippe Morency ; Alan Black ; Maxine Eskenazi

In this work, we present a dynamic response spoken dialogue system (DRSDS). It is capable of understanding the verbal and nonverbal language of users and making instant, situation-aware response. Incorporating with two external systems, MultiSense and email summarization, we built an email reading agent on mobile device to show the functionality of DRSDS.