Human-Autonomy Teaming Essential Research Program Project 2: Transparent Multimodal Crew Interface Designs, Technical Note 3: Multimodal Cueing for Transparency in Mobility Operations

Abstract

This technical note, the third in its series, describes the use of multimodal cueing concepts to improve mission execution. This work is a subcomponent of the US Army Combat Capabilities Development Command (CCDC) Army Research Laboratory's (ARLs) second project in the Human-Autonomy Teaming Essential Research Program, transparent multimodal crew interface designs, in support of the US Army modernization priority--Next Generation Combat Vehicle (NGCV). The goal of this project was to improve crew members understanding of autonomous systems actions, intentions, goals, and general reasoning by at least 25 . To achieve this goal, a team of CCDC Army Research Laboratory scientists and contractor engineers developed iterative improvements to the NGCV Warfighter Machine Interface aimed at addressing multiple stages of the mission, from planning to execution. Interface improvements included a multimodal (tactile and auditory) cueing system designed to improve crew members local situation awareness while commanding simulated autonomous robotic combat vehicles, a display for evaluating tradeoffs in Multi Domain Operations, and improvements to existing route-planning functionality. These interface improvements were implemented and tested in ARLs Information for Mixed Squads Laboratory, which permits the simulation of up to platoon-level operations. This note describes the scientific background for, and ideation, implementation, and testing of a multimodal cueing system.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 28, 2020
Accession Number
AD1100839

Entities

People

  • Angelique Scharine
  • Brandon S. Perelman
  • David Chhan

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Autonomy
  • Human Systems
  • Space
  • Weapons Technologies

DTIC Thesaurus Topics

  • Armored Vehicles
  • Audio Files
  • Auditory Signals
  • Autonomous Navigation
  • Autonomous Systems
  • Autonomous Vehicles
  • Autonomy
  • Cognitive Workload
  • Combat Vehicles
  • Command And Control
  • Data Displays
  • Department Of Defense
  • Detectors
  • Engineering
  • Frequency
  • Guidance
  • Human Factors Engineering
  • Human-Machine Interaction
  • Improvised Explosive Devices
  • Military Research
  • Mobility
  • Motion Sickness
  • Navigation
  • Psychology
  • Reasoning
  • Simulators
  • Situational Awareness
  • Unmanned Vehicles
  • Vehicles
  • Warning Systems

Readers

  • Human-Computer Interaction (HCI).
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.
  • Unmanned Aerial System (UAS) Autonomous Capabilities and Mission Reconnaissance.

Technology Areas

  • AI & ML
  • AI & ML - Autonomous Systems
  • AI & ML - DoD AI Strategy
  • Autonomy
  • Autonomy - Human-Robot Interaction