RESEARCH

HOME RESEARCH
Behavior Computing
Speech and Language
Other: Signal Modeling for Understanding
Based on isolated saliency or causal integration? toward a better understanding of human annotation process using multiple instance learning and sequential probability ratio test
Abstract
Human perception is capable of integrating local events to generate an overall impression at the global level; this is evident in daily life and is utilized repeatedly in behavioral science studies to bring objective measures into studies of human behavior. In this work, we explore two hypotheses considering whether it is the isolated-saliency or the causal-integration of information that can trigger the global perceptual behavioral ratings as trained annotators engage in tasks of observational coding. We carry out analyses using Multiple Instance Learning and Sequential Probability Ratio Test in a corpus of real and spontaneous distressed couples’ interaction with global sessionlevel abstract behavioral coding done by trained human annotators. We present various analyses based on different behavioral detection schemes demonstrating the potential of utilizing these algorithms in bringing insights into the human annotation process. We further show that while annotating behaviors with more positive impression, annotators gather information throughout the session compared to behaviors with more negative impression, where a single salient instance is enough to trigger the final global decision.
Figures
Summary of detection results (percentage of accurately detected sessions): numbers in bold indicate the highest performing decision framework for that specific task
Summary of detection results (percentage of accurately detected sessions): numbers in bold indicate the highest performing decision framework for that specific task
Keywords
multiple instance learning | sequential probability ratio test | behavior annotation, perception | observational coding
Authors
Publication Date
2012/09/03
Conference
Interspeech
Interspeech 2012
DOI
10.21437/Interspeech.2012-187
Publisher
ISCA