Finding the FOO: A Pilot Study for a Multimodal Interface

Abstract

In their research on intuitive means for humans and intelligent, mobile robots to collaborate, the authors use a multimodal interface that supports speech and gestural inputs. As a preliminary step to evaluate their approach and to identify practical areas for future work, they conducted a Wizard-of-Oz pilot study with five participants who each collaborated with a robot on a search task in a separate room. The goal was to find a sign in the robot's environment with the word "FOO" printed on it. Using a subset of their multimodal interface, participants were told to direct the collaboration. As their subordinate, the robot would understand their utterances and gestures, and recognize objects and structures in the search space. Participants conversed with the robot through a wireless microphone and headphone and, for gestural input, used a touch screen displaying alternative views of the robot's environment to indicate locations and objects.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2003
Accession Number
ADA434963

Entities

People

  • Alan C. Schultz
  • Dennis J. Perzanowski
  • Derek Brock
  • J. Gregory Trafton
  • Magdalena Bugajska
  • Majorie Skubic
  • Sam Blisard
  • William Adams

Organizations

  • United States Naval Research Laboratory

Tags

DTIC Thesaurus Topics

  • Cameras
  • Computers
  • Directives
  • Environment
  • Human-Robot Interaction
  • Instructions
  • Language
  • Natural Languages
  • Navigation
  • Personal Digital Assistants
  • Pilot Studies
  • Psychology
  • Reconnaissance
  • Robotics
  • Robots
  • User Interface
  • Video Cameras

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Speech Processing/Speech Recognition.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • Autonomy
  • Autonomy - Human-Robot Interaction
  • Space
  • Space - Spacecraft Maneuvers