The Role of Context in Affective Behavior Understanding

Abstract

Face-to-face communication is highly interactive. Even when only one person speaks at the time, other participants exchange information continuously amongst themselves and with the speaker through gesture, gaze, posture and facial expressions. Such affective feedback is an essential and predictable aspect of natural conversation and its absence can significantly disrupt participants ability to communicate [2, 20]. During multi-party interactions such as in meetings, information is exchanged between participants using both audio and visual channels. Visual feedback can range from a simple eye glance to a large arm gesture or posture change. One important visual cue is head nod during conversation. Head nods are used for displaying agreement, grounding information or during turn-taking [7, 8]. Recognizing these affective gestures is important for understanding all the information exchanged during a meeting or conversation, and can be particularly crucial for identifying more subtle factors such as the effectiveness of communication [17], points of confusion, status relationships between participants [18], or the diagnosis social disorders [15].

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2010
Accession Number
AD1171468

Entities

People

  • Louis-Philippe Morency

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Algorithms
  • Analysis Of Variance
  • Artificial Intelligence
  • Automated Speech Recognition
  • Coding
  • Computational Science
  • Feature Selection
  • Hidden Markov Models
  • Human-Machine Interaction
  • Language
  • Markov Models
  • Models
  • Natural Language Processing
  • Probabilistic Models
  • Probability
  • Recognition
  • Social Psychology
  • Speech

Readers

  • Speech Processing/Speech Recognition.
  • Theoretical Analysis.
  • Vision Science/Vision Psychology/Cognitive Neuroscience.