Criterion Referenced Measures of Technical Proficiency in Maintenance Activities.

Abstract

This paper concerns instruments used to determine how efficiently maintenance men perform the various tasks of their jobs. Currently, a great deal of reliance is placed on unvalidated knowledge tests, theory tests, school marks, and supervisor's ratings. The limitations of tradiational systems effectiveness measures are discussed. Although job task performance tests (JTPT) have higher empirical validity, such tests have had very limited use because of their relatively high cost in time, personnel and equipment. Consequently this laboratory has supported studies to develop better criterion referenced JTPT, and to develop paper and pencil symbolic substitute tests of high empirical validity. The paper describes the model battery of 48 criterion referenced JTPT, which has been developed to cover all key maintenance activities such as checkout, align/adjust, remove/replace, troubleshooting, test equipment and soldering. Many factors were considered including the identification and classification of tasks to be measured, the hierarchal relationship of maintenance tasks, the most effective order of their measurement and the ease of test administration. This battery was developed as a model of JTPT to be used on the job and in training. It was also intended as a battery of criterion tests for the validation of paper and pencil symbolic substitute tests. Batteries of graphic and video symbolic substitute tests were developed and given limited validations. The validation of graphic symbolic substitute tests indicated that the symbolics for all activities with the exception of soldering, have promise. An unsuccessful effort to develop video symbolic substitute tests is also mentioned.

Document Details

Document Type
Technical Report
Publication Date
Oct 01, 1975
Accession Number
ADA016420

Entities

People

  • John P. Foley Jr.

Organizations

  • Brooks Air Force Base

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Classification
  • Identification
  • Maintenance
  • Maintenance Personnel
  • Measurement
  • Performance Tests
  • Ratings
  • Soldering
  • Task Performance And Analysis
  • Test Equipment
  • Training
  • Troubleshooting
  • Validation

Readers

  • Instructional Design and Training Evaluation.
  • Psychometric Testing or Psychological Assessment.