Generalizability of Performance Measures Across Four Air Force Specialties

Abstract

Generalizability (G) theory was used to assess the reliability of criterion measures across four Air Force specialties. This analysis strategy was applied to work sample tests (i.e., Walk-Through Performance Test (WTPT) scores) and ratings of job proficiency. Results indicated that WTPT scores were reliable with each specialty. In addition, ratings were reliable across different rating forms (i.e., general to specific) and within rating sources (i.e., incumbents, peers, and supervisors). However, ratings were not generalizable across rating sources, and ratings were not substitutable for WTPT scores. These results were consistent across the four specialties, lending increased confidence to the findings. G-theory, Generalizability, Job performance measurement, Performance ratings, Reliability, Walk-through performance test, Work sample test.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 1990
Accession Number
ADA220821

Entities

People

  • Kurt Kraiger

Organizations

  • University of Denver

Tags

Communities of Interest

  • C4I
  • Human Systems

DTIC Thesaurus Topics

  • Air Force Facilities
  • Air Traffic Controllers
  • Applied Psychology
  • Colorado
  • Data Science
  • Descriptive Analytics
  • Human Factors Engineering
  • Human Resources
  • Information Science
  • Military Personnel
  • Performance Tests
  • Personnel Management
  • Psychology
  • Specialists
  • Supervisors
  • Test And Evaluation
  • Training

Fields of Study

  • Psychology

Readers

  • Instructional Design and Training Evaluation.