RESEARCH

HOME RESEARCH
Behavior Computing
Spoken Dialogs
IEMOCAP: interactive emotional dyadic motion capture database
Abstract
Since emotions are expressed through a combination of verbal and nonverbal channels, a joint analysis of speech and gestures is required to understand expressive human communication. To facilitate such investigations, this paper describes a new corpus named the "interactive emotional dyadic motion capture database" (IEMOCAP), collected by the Speech Analysis and Interpretation Laboratory (SAIL) at the University of Southern California (USC). This database was recorded from ten actors in dyadic sessions with markers on the face, head, and hands, which provide detailed information about their facial expressions and hand movements during scripted and spontaneous spoken communication scenarios. The actors performed selected emotional scripts and also improvised hypothetical scenarios designed to elicit specific types of emotions (happiness, anger, sadness, frustration and neutral state). The corpus contains approximately 12 h of data. The detailed motion capture information, the interactive setting to elicit authentic emotions, and the size of the database make this corpus a valuable addition to the existing databases in the community for the study and modeling of multimodal and expressive human communication.
Figures
Marker layout. In the recording, 53 markers were attached to the faces of the subjects.
Marker layout. In the recording, 53 markers were attached to the faces of the subjects.
Keywords
Audio-visual database | Dyadic interaction | Emotion | Emotional assessment | Motion capture system
Publication Date
2008/11/05
Journal
Language Resources and Evaluation 2008 Vol. 42
DOI
10.1007/s10579-008-9076-6
Publisher
Springer