Multimodal Interaction for Wearable Augmented Reality Environments

Abstract

We describe an approach to natural 3D multimodal interaction in immersive environments. Our approach fuses symbolic and statistical information from a set of 3D gesture and speech agents, building in part on prior research on disambiguating the user's intent in 2D and 2.5D user interfaces. We present an experimental system architecture that embodies this approach, and provide examples from a preliminary 3D multimodal testbed to explore our ideas in augmented and virtual reality.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Feb 28, 2003
Accession Number
ADA414964

Entities

People

  • Philip R. Cohen

Organizations

  • Oregon Health & Science University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Augmented Reality
  • Cognitive Systems Engineering
  • Computational Linguistics
  • Computational Science
  • Computer Graphics
  • Computer Languages
  • Computers
  • Grammars
  • Human Systems Integration
  • Human-Computer Interaction
  • Human-Machine Interaction
  • Language
  • Linguistics
  • Natural Language Processing
  • Three Dimensional
  • User Interface
  • Virtual Reality

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Theoretical Analysis.