Towards Seamless Integration in a Multi-modal Interface

Abstract

We are designing and implementing a multi-modal interface to an autonomous robot. For this interface, we have elected to use natural language and gesture. Gestures can be either natural gestures perceived by a vision system installed on the robot, or they can be made by using a stylus on a Personal Digital Assistant. In this paper we describe how we are attempting to provide a seamless integration of the various modes of input to provide a multi-modal interface that humans can manipulate as they desire. The interface will allow the user to choose whatever mode or combination of modes seems appropriate for interactions with the robot. The human user, therefore, does not have to be limited to any one mode of interaction, but can freely choose whatever mode is most comfortable or natural.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2000
Accession Number
ADA434973

Entities

People

  • Alan C. Schultz
  • Dennis J. Perzanowski
  • Elaine Marsh
  • William Adams

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Acoustic Signals
  • Artificial Intelligence
  • Cognitive Systems Engineering
  • Command And Control
  • Computers
  • Human-Computer Interaction
  • Language
  • Military Research
  • Natural Language Processing
  • Natural Languages
  • Personal Digital Assistants
  • Robotics
  • Robots
  • User Interface

Readers

  • Joint Military Operations and Doctrine.
  • Robotics and Automation.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Machine Translation
  • Autonomy
  • Autonomy - Human-Robot Interaction