Integrated Measurement of Crew Resource Management and Technical Flying Skills

Abstract

This report presents the findings of a study designed with two objectives: to produce a prototype performance measurement instrument (PMI) that integrates the assessment of Crew Resource Management (CRM) and technical flying skills and to investigate the suitability of the Critical Decision method (CDM) for eliciting expert information concerning performance measurement. The work was funded by the FAA in support of the Advanced Qualification Program (AQP) and conducted in cooperation with a major U.S. carrier. The researchers used CDM to identify critical components of performance assessment for specific flight tasks and developed a prototype PMI. The instrument contains two sections for each task. One section allows an evaluator to record significant pilot and crew behaviors observed; the second section allows the evaluator to provide a subjective assessment of pilot and crew proficiency. The researchers pretested the instrument and made revisions based on recommendations from experienced instructors. The researchers then evaluated the PMI with eight instructors observing a total of 16 different flight crews in recurrent training, performing a standard Line Oriented Flight Training (LOFT) scenario in a flight simulator. The instructors reliably and accurately employed the PMI to assess performance of the crew and the individual pilot. The authors recommended that AQP developers use Cognitive Task Analysis (CTA) techniques to develop training programs for cognitive and team tasks. Human factors, Evaluation, Cockpit resource management, CRM, Critical decision method, CDM, Line oriented flight training.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 1993
Accession Number
ADA270512

Entities

People

  • David W. Klinger
  • George L. Kaempf

Organizations

  • Battelle Memorial Institute

Tags

Communities of Interest

  • Air Platforms
  • Biomedical
  • Human Systems
  • Weapons Technologies

DTIC Thesaurus Topics

  • Air Force
  • Aircrafts
  • Cognition
  • Cognitive Workload
  • Commercial Aviation
  • Flight Crews
  • Flight Instruments
  • Flight Simulators
  • Flight Training
  • Measurement
  • Military Research
  • Personnel Management
  • Pilots
  • Psychology
  • Situational Awareness
  • Students
  • Task Performance And Analysis

Readers

  • Aviation Safety Risk Assessment.
  • Instructional Design and Training Evaluation.
  • Organizational Process Management (OPM).