Validation and Evaluation of Army Aviation Collective Performance Measures

Abstract

Simulation-based Aviation Training Exercises are critical for preparing U.S. Army Combat Aviation Brigades for deployment. However, while offering the opportunity to practice mission segments at the unit level, the effectiveness of this training remains unclear due to a need for objective assessments focused on observable team behavior. Unit Commanders and trainers need tools for measuring collective task performance in order to understand performance gains, facilitate feedback, and guide the learning of aviation tactical teams. To address this challenge, a set of aviation team performance measures were developed, data were collected to validate these measures, and strategies were created to facilitate application of the measures to collective training events. The measures used behaviorally-based observations to assess performance of aviation tactical teams. The measures were evaluated at multiple training events to assess overall utility. Data were collected on inter-rater reliability and on agreement between the measures and overall mission performance. Results provided evidence of both acceptable reliability and validity for the measures. Moreover, requirements were developed for electronic data collection tools that can be used by unit Commanders and trainers to assess team performance at collective training exercises.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2014
Accession Number
ADA596907

Entities

People

  • Courtney Dean
  • Jeanine Ayers
  • Martin L. Bink
  • Troy Zeidman

Organizations

  • Aptima (United States)

Tags

Communities of Interest

  • Biomedical
  • C4I
  • Human Systems
  • Weapons Technologies

DTIC Thesaurus Topics

  • Acquisition
  • Applied Psychology
  • Army Aviation
  • Collateral Damage
  • Deployment
  • Human Systems Integration
  • Military Training
  • Observation
  • Personnel Management
  • Psychology
  • Reliability
  • Simulations
  • Social Sciences
  • Target Acquisition
  • Test And Evaluation
  • Training
  • Weapons Effects

Readers

  • Instructional Design and Training Evaluation.
  • Military Training and Readiness Simulation
  • Systems Analysis and Design

Technology Areas

  • Microelectronics