Development and Usability Assessment of the Real-time Event, Flow, and Coordination Tool (REFLECT)

Abstract

This report details the development and initial usability assessment of the Real-time Event, Flow, and Coordination Tool (REFLECT), which allows a user to capture team communication flow in real time. This is critical for advancing US Army initiatives in human autonomy teaming because communication flow affects, and is affected by, intelligent systems interactions, team structures, and tasking demands associated with the novel metric of team trust and cohesion. In our initial usability assessment, participants used REFLECT to capture team communication flow using audio recordings from the US Army Wingman Joint Capabilities Technology Demonstration, where a five-person crew engaged in mounted machine-gun live-fire exercises involving a manned unmanned team. After using REFLECT, participants completed questionnaires and interviews regarding its design and use. Participants achieved approximately 70 percent accuracy in correctly identifying speakers and recipients of communication exchanges with an average delay of about 2 s. Participant feedback suggests that the tool is easy to use but also provides directed insight into areas for improvement.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 2020
Accession Number
AD1106484

Entities

People

  • Anthony L Baker
  • Kristin E. Schaefer
  • Ralph W. Brewer

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Accuracy
  • Artificial Intelligence
  • Audio Files
  • Autonomy
  • Cohesion
  • Computer Languages
  • Computer Programming
  • Computers
  • Graphical User Interface
  • Intelligent Systems
  • Machine Guns
  • Psychology
  • Spreadsheet Software
  • Test And Evaluation
  • Unmanned Systems
  • Unmanned Vehicles
  • User Interface

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Mathematics or Statistics
  • Military Training and Readiness Simulation

Technology Areas

  • Autonomy
  • Autonomy - Human-Robot Interaction