Application of Generalizability Theory to the Air Force Job Performance Measurement Project: A Summary of Research Results

Abstract

Generalizability theory was used to assess the psychometric quality of Walk-Through Performance Tests (WTPTs) and job proficiency ratings in eight occupational specialties. In addition, generalizability theory was used to determine whether proficiency ratings and job knowledge test scores were substitutable for the WTPTs. The results showed that both the WTPT scores and ratings within rating sources were generalizable (reliable), but that ratings were not generalizable over rating sources, and neither ratings nor job knowledge test scores, and neither ratings nor job knowledge test scores ranked incumbents similarly to the WTPT.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1991
Accession Number
ADA239050

Entities

People

  • Kurt Kraiger
  • Mark S. Teachout

Organizations

  • University of Colorado Boulder

Tags

Communities of Interest

  • Human Systems
  • Space

DTIC Thesaurus Topics

  • Air Force
  • Air Traffic
  • Computer Programs
  • Data Analysis
  • Human Resources
  • Information Systems
  • Jet Engines
  • Measurement
  • Military Personnel
  • Performance Tests
  • Personnel Management
  • Psychology
  • Reliability
  • Statistical Samples
  • Students
  • Test And Evaluation
  • Training

Readers

  • Instructional Design and Training Evaluation.