Gesture-Based Controls for Robots: Overview and Implications for Use by Soldiers

Abstract

This report provides an overview of gestural controls of robots in general, followed by a discussion of issues more specific to control of military ground robots by dismounted Soldiers. For the field of gestural controls, the technological progress is rapid and distributed among many different approaches, and the number of relevant publications is huge. A review of literature is provided, focused on 2 types of technological approach: camera-based and wearable instrumented devices. Handheld devices are also discussed in terms of augmenting gesture precision (i.e., pointing gestures). Attention is given to issues related to relative advantages of each approach for effective recognition and parsing of gestures, particularly in terms of their relevance to dismounted Soldier systems. Human-factors issues regarding the interaction of Soldiers and technology and effective design of user interfaces and controls are fundamental to successful use. This report identifies the major issues regarding applications to dismounted military operations.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 2016
Accession Number
AD1011904

Entities

People

  • Linda R. Elliott
  • Michael Barnes
  • Susan G. Hill

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Automata Theory
  • Autonomous Navigation
  • Cognitive Systems Engineering
  • Computational Science
  • Computer Languages
  • Computer Programming
  • Computer Vision
  • Computers
  • Human Systems Integration
  • Human-Machine Interaction
  • Human-Robot Interaction
  • Information Systems
  • Military Research
  • Robots
  • Test And Evaluation
  • Three Dimensional

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Military Science and Technology Research and Modernization.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • Autonomy