Crowd‐Sourcing Real‐World Human‐Robot Dialogue and Teamwork through Online Multiplayer Games

Abstract

We present an innovative approach for large‐scale data collection in human‐robot interaction research through the use of online multi‐player games. By casting a robotic task as a collaborative game, we gather thousands of examples of human‐human interactions online, and then leverage this corpus of action and dialogue data to create contextually relevant social and task‐oriented behaviors for human‐robot interaction in the real world. We demonstrate our work in a collaborative search and retrieval task requiring dialogue, action synchronization, and action sequencing between the human and robot partners. A user study performed at the Boston Museum of Science shows that the autonomous robot exhibits many of the same patterns of behavior that were observed in the online data set and survey results rate the robot similarly to human partners in several critical measures.

Document Details

Document Type
Pub Defense Publication
Publication Date
Dec 01, 2011
Source ID
10.1609/aimag.v32i4.2380

Entities

People

  • Cynthia Breazeal
  • Nick Depalma
  • Sonia Chernova

Organizations

  • Microsoft Research
  • Office of Naval Research

Tags

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • Autonomy
  • Autonomy - Human-Robot Interaction