RESEARCH

HOME RESEARCH
Health Analytics
Spoken Dialogs
Speech and Language
Other: Signal Modeling for Understanding
Interplay between verbal response latency and physiology of children with autism during ECA interactions
Abstract
The affective state of children with autism is not always expressed or discernible through observational cues, a phenomenon which is further confounded by vast variability across individuals on the autism spectrum. Electrodermal Activity (EDA) is a physiological signal indicative of a person's arousal and thus affording us new insights into a child's inner affective state. In this work we study EDA cues of children with autism while interacting with an Embodied Conversational Agent (ECA). EDA is affected by both cognitive and social factors. In this paper, we consider the child's verbal response latency as the overt behavioral cue and link it with his/her physiology. A classification experiment was performed to differentiate between physiological cues of high and low verbal response latency intervals, based on the assumption that different kinds of mechanisms are triggered in each case. Our results indicate that physiological patterns between short and long verbal response latencies are more discriminative for some children than others, suggesting the existence of multiple levels of cognitive and social efforts across children. They also show variable levels of arousal response, which can provide a complementary view of the observational cues.
Figures
Total count (written at the legend) and distribution of the nine subjects’ verbal response latencies (in seconds) with respect to Rachel’s turns. The vertical solid black bar at each subfigure represents 70th percent threshold (to the left).
Total count (written at the legend) and distribution of the nine subjects' verbal response latencies (in seconds) with respect to Rachel's turns. The vertical solid black bar at each subfigure represents 70th percent threshold (to the left).
Keywords
Electrodermal response | verbal response latency | affective state | cognitive and social activity | autism
Authors
Publication Date
2012/09/09
Conference
Interspeech
Interspeech 2012
DOI
10.21437/Interspeech.2012-316
Publisher
ISCA