Director: A User Interface Designed for Robot Operation with Shared Autonomy

Abstract

Operating a high degree of freedom mobile manipulator, such as a humanoid, in a field scenario requires constant situational awareness, capable perception modules, and effective mechanisms for interactive motion planning and control. A well‐designed operator interface presents the operator with enough context to quickly carry out a mission and the flexibility to handle unforeseen operating scenarios robustly. By contrast, an unintuitive user interface can increase the risk of catastrophic operator error by overwhelming the user with unnecessary information. With these principles in mind, we present the philosophy and design decisions behind Director—the open‐source user interface developed by Team MIT to pilot the Atlas robot in the DARPA Robotics Challenge (DRC). At the heart of Director is an integrated task execution system that specifies sequences of actions needed to achieve a substantive task, such as drilling a wall or climbing a staircase. These task sequences, developed a priori, make online queries to automated perception and planning algorithms with outputs that can be reviewed by the operator and executed by our whole‐body controller. Our use of Director at the DRC resulted in efficient high‐level task operation while being fully competitive with approaches focusing on teleoperation by highly trained operators. We discuss the primary interface elements that comprise Director, and we provide an analysis of its successful use at the DRC.

Document Details

Document Type
Pub Defense Publication
Publication Date
Dec 26, 2016
Source ID
10.1002/rob.21681

Entities

People

  • Andres Valenzuela
  • Claudia Pérez D'arpino
  • Greg Izatt
  • Hongkai Dai
  • John Carter
  • Lucas Manuelli
  • Matt Antone
  • Maurice Fallon
  • Pat Marion
  • Robin Deits
  • Russ Tedrake
  • Scott Kuindersma
  • Twan Koolen

Organizations

  • Air Force Research Laboratory
  • Defense Advanced Research Projects Agency
  • Harvard University
  • Massachusetts Institute of Technology
  • Office of Naval Research
  • University of Edinburgh

Tags

Fields of Study

  • Computer science

Readers

  • Distributed Systems and Data Platform Development
  • Robotics and Automation.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - DoD AI Strategy
  • Autonomy
  • Autonomy - Human-Robot Interaction