Reliability of Mechanical Maintenance Performance Measures

Abstract

A fundamental requirement in the development and administration of performance measures is that such assessments should result in reliable scores that accurately indicate a person's level of proficiency. This research memorandum examines the reliability of two performance measures of mechanical maintenance developed for the Marine Corps Job Performance Measurement Project: hands-on performance tests and job knowledge tests. Multiple estimates of reliability were computed, and the consistency of test administrators in scoring hands-on performance was specifically examined. The hands-on performance tests and the job knowledge tests were found to result in very reliable measurements. Properly trained and monitored test administrators were able to score hands-on performance consistently across examinees, over time, and for different test content. Implications for subsequent performance measurement are presented, and possible training implications based on mechanics who were retested are noted.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Feb 01, 1992
Accession Number
ADA263896

Entities

People

  • Paul W. Mayberry
  • William H. Wright

Organizations

  • Center for Naval Analyses

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Aircrafts
  • Analysis Of Variance
  • Consistency
  • Helicopters
  • Job Analysis
  • Maintenance
  • Marine Corps
  • Measurement
  • Mechanics
  • Performance Tests
  • Personnel Management
  • Reliability
  • Statistical Analysis
  • Statistics
  • Task Performance And Analysis
  • Test Methods
  • Training

Readers

  • Computational Modeling and Simulation
  • Naval Personnel Management
  • Software Engineering