An Evaluation of Automatic Lip-syncing Methods for Game Environments

Abstract

Lip-synching is the production of articulator motion corresponding to a given audible utterance. The Mission Rehearsal Exercise training system requires lip-synching to increase the believability of its virtual agents. In this report I document the selection, exploration, evaluation and comparison of several candidate lip-synching systems, ending with a recommendation. The evaluation focuses on the believability of articulators expression, the foreseeable difficulty of integration into MREs architecture, the support for facial expressions related to semantics and prosodic features as well as the scalability of each system

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2005
Accession Number
AD1170801

Entities

People

  • Arien Kock
  • Jonathan Gratch

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Audio Files
  • Computer Programming
  • Computer Programs
  • Computer Science
  • Computers
  • Geometry
  • Language
  • Mixed Reality
  • Motion Capture
  • Programming Languages
  • Reliability
  • Simulations
  • Speech
  • Standards
  • Test And Evaluation
  • Training
  • Two Dimensional
  • Virtual Reality
  • Websites

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computational Linguistics
  • Speech Processing/Speech Recognition.