Review of Command Group Training Measurement Methods

Abstract

This report documents a literature review of performance measurement for command group training, as well as providing a discussion of potential sources of performance data. Specific measurement techniques (i.e., self- assessment, peer assessment, ARTEP, probes, battle outcome data, etc.), which have been applied and reported in the literature, are analyzed against 10 performance measurement criteria. Of those measurement techniques analyzed, none favorably met all 10 of the established criteria. The analysis resulted in the determination that no one technique is acceptable in its present form for diagnosis and feedback in command group training, and that some combination of techniques, with refinements, will be needed. Several conclusions based upon the results are as follows: a) External observers are to be preferred over peer-or self-assessment. b) Probes can enhance training exercises as well as present situations for measurement of subsequent performance. c) Information flow and other testing techniques rate better than observation or summarization techniques in terms of objectivity, accuracy, validity, and reliability. Areas identified for further research and development include better assessment of measurement techniques, especially in terms of validity, reliability, and accuracy; refinement of measures for staff perceptions, information usage, and secondary task performance; various uses of automated simulation and data tracking techniques; and better understanding of staff performance.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1988
Accession Number
ADA201753

Entities

People

  • Delane K. Garlinger
  • Jon J. Fallesen

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Communities of Interest

  • C4I
  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Army Training
  • Classification
  • Cognitive Science
  • Cognitive Workload
  • Combat Readiness
  • Command And Control
  • Construction
  • Feedback
  • Literature Surveys
  • Measurement
  • Psychology
  • Social Sciences
  • Standards
  • Test And Evaluation
  • Test Methods
  • Training

Fields of Study

  • Education

Readers

  • Military Training and Readiness Simulation
  • Psychometric Testing or Psychological Assessment.
  • Systems Analysis and Design