Modeling the Interaction between Speech and Gesture.

Abstract

This paper describes an implemented system that generates spoken dialogue, including speech, intonation, and gesture, using two copies of an identical program that differ only in knowledge of the world and which must cooperate to accomplish a goal. The output of the dialogue generation is used to drive a three-dimensional interactive animated model - two graphic figures on a computer screen who speak and gesture according to the rules of the system. The system is based upon a formal, predictive and explanatory theory of the gesture-speech relationship. A felicitous outcome is a working system to realize autonomous animated conversational agents for virtual reality and other purposes, and a tool for investigating the relationship between speech and gesture.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 1994
Accession Number
ADA290549

Entities

People

  • Brett Achorn
  • Brett Douville
  • Justine Cassell
  • Matthew Stone
  • Scott Prevost

Organizations

  • Moore School of Electrical Engineering

Tags

Communities of Interest

  • Autonomy
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Air Force
  • Cognitive Science
  • Computational Linguistics
  • Computers
  • Demographic Cohorts
  • Engineering
  • Geometry
  • Information Science
  • Language
  • Linguistics
  • Military Research
  • Semantics
  • Simulations
  • Standards
  • Syllables
  • Three Dimensional

Readers

  • Computational Modeling and Simulation
  • Educational Psychology
  • Speech Processing/Speech Recognition.