Human-Robot Dialogue and Collaboration in Search and Navigation

Abstract

Collaboration with a remotely located robot in tasks such as disaster relief and search and rescue can be facilitated by grounding natural language task instructions into actions executable by the robot in its current physical context. The corpus we describe here provides insight into the translation and interpretation a natural language instruction undergoes starting from verbal human intent, to understanding and processing, and ultimately, to robot execution. We use a Wizard-of-Oz methodology to elicit the corpus data in which a participant speaks freely to instruct a robot on what to do and where to move through a remote environment to accomplish collaborative search and navigation tasks. This data offers the potential for exploring and evaluating action models by connecting natural language instructions to execution by a physical robot (controlled by a human wizard). In this paper, a description of the corpus (soon to be openly available) and examples of actions in the dialogue are provided.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2018
Accession Number
AD1171061

Entities

People

  • Ashley Foots
  • Cassidy Henry
  • Claire Bonial
  • Clare R. Voss
  • David R Traum
  • Kimberly A. Pollard
  • Matthew Marge
  • Ron Artstein
  • Stephanie M. Lukin

Organizations

  • University of Southern California

Tags

DTIC Thesaurus Topics

  • Autonomous Navigation
  • Control Systems
  • Dialogue Systems
  • Environment
  • Feedback
  • Human-Robot Interaction
  • Humanitarian Assistance
  • Information Exchange
  • Instructions
  • Language
  • Natural Languages
  • Navigation
  • Robot Navigation
  • Robotics
  • Robots
  • Search And Rescue
  • Text Messaging
  • Training
  • Translations

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Theoretical Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - Machine Translation
  • Autonomy
  • Autonomy - Human-Robot Interaction