Multi-modal Interfacing for Human-Robot Interaction

Abstract

CONCLUSIONS: 1. By using "context predicates" we track actions occurring during a dialog to determine which goals (event and locative) have been achieved or attained and which have not. 2. By tracking "context predicates" we can determine what actions need to be acted upon next; i.e., predicates in the stack that have not been completed. 3. "Locative" expressions, e.g. "there," give us a kind of handle in command and control applications to attempt error correction when locative goals are being discussed. 4. By interleaving complex dialog with natural and mechanical gestures, we hope to achieve dynamic autonomy and an integrated multi-modal interface.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2001
Accession Number
ADA434974

Entities

People

  • Alan Schultz
  • Dennis J. Perzanowski
  • Elaine March
  • Magda Bugajska
  • William Adams

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Aircrafts
  • Artificial Intelligence
  • Autonomous Underwater Vehicles
  • Command And Control
  • Computer Programming
  • Human-Machine Interaction
  • Human-Robot Interaction
  • Language
  • Lisp Programming Language
  • Natural Languages
  • Personal Digital Assistants
  • Robots
  • Underwater Vehicles

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Computational Linguistics
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Machine Translation
  • Autonomy
  • Autonomy - Human-Robot Interaction
  • Fully Networked C3
  • Fully Networked C3 - Command and Control