Toward Multimodal Human-Robot Cooperation and Collaboration

Abstract

Our multimodal interface integrates speech recognition, natural language understanding, spatial reasoning and human cognitive models for completing specific tasks and for perspective-taking in locative oriented tasks. With natural language and gestures, we believe human-robot interaction and communication is facilitated. Instead of concentrating on the various modalities of the interface, users can concentrate on the task at hand. Likewise, by incorporating human cognitive models for handling spatial information and perspective-taking, as well as for specific task completion, a better match with the expectations that humans acquire from their human-human interactions should be obtained, further facilitating cooperation and collaboration in human-robot interactions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2004
Accession Number
ADA622230

Entities

People

  • Alan C. Schultz
  • Dennis J. Perzanowski
  • Derek Brock
  • Donald Sofge
  • J. Gregory Trafton
  • Magdalena Bugajska
  • Marjorie Skubic
  • Nicholas Cassimatis
  • Sam Blisard
  • Scott Thomas
  • William Adams

Organizations

  • United States Naval Research Laboratory

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Automata Theory
  • Automated Speech Recognition
  • Cognitive Science
  • Computers
  • Cooperation
  • Graphical User Interface
  • Human-Robot Interaction
  • Human-Robot Interfaces
  • Intelligent Systems
  • Language
  • Military Research
  • Natural Language Understanding
  • Natural Languages
  • Personal Digital Assistants
  • Robotic Swarms
  • Robots

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Machine Translation
  • Autonomy
  • Autonomy - Autonomous System Control
  • Autonomy - Human-Robot Interaction