Multimodal Interaction for Virtual Environments

Abstract

We describe an approach to natural 3D multimodal interaction in immersive environments. Our approach fuses symbolic and statistical information from a set of 3D gesture and speech agents building in part on prior research on disambiguating the user's intent in 2D and 2.5D user interfaces. We present an experimental system architecture that embodies this approach, and provide examples from a preliminary 3D multimodal testbed to explore our ideas in augmented and virtual reality

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1999
Accession Number
ADA413862

Entities

People

  • Philip R. Cohen

Tags

Communities of Interest

  • Autonomy
  • Cyber
  • Energy and Power Technologies
  • Human Systems
  • Sensors

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Augmented Reality
  • Cognitive Systems Engineering
  • Computational Linguistics
  • Computational Science
  • Computer Graphics
  • Computer Languages
  • Human Systems Integration
  • Human-Computer Interaction
  • Human-Machine Interaction
  • Language
  • Linguistics
  • Natural Language Processing
  • Recognition
  • Three Dimensional
  • User Interface
  • Virtual Reality

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Neural Network Machine Learning.