Wearable Smart Interaction Device (SID) for Advanced Human-Robot Interaction Using Gestures and/or Speech
Abstract
Robotic assets used by dismounted Soldiers have usually been controlled through continuous and effortful teleoperation; however, more autonomous capabilities have been developed that reduce the need for continuous control of movements. While greater autonomy can make robotic systems more useful, users still need to interact with them, and operator control units for deployed robots still primarily rely on manual controllers such as joysticks. This report describes an evaluation of a multimodal interface that leverages speech and gesture through a wrist-worn device to enable an operator to direct a robotic vehicle using ground guide-inspired or infantry-inspired commands through voice or gesture. A smart watch is the primary interaction device, allowing for spoken input (through the microphone) and gesture input using single-arm gestures. Both modalities were shown to be useful, with each approach having particular advantages, depending on operational context.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jul 31, 2018
- Accession Number
- AD1057391
Entities
People
- Glenn Taylor
- Linda R. Elliott
- Rodger Pettitt
Organizations
- United States Army Research Laboratory