Evaluation of Criterion-Related Validity and Potential Item Exposure Effects for the Weighted Airman Promotion System (WAPS)
Abstract
The Weighted Airman Promotion System (WAPS) determines promotions to non-commissioned officer (NCO) ranks within the U.S. Air Force (USAF). The WAPS comprises a formula for weighting various components characterizing an Airman's readiness for promotion. Two standardized tests (multiple-choice format, each having 100 items) serve as WAPS components: (a) a Specialty Knowledge Test (SKT) a measure of technical knowledge pertaining to the Air Force specialty (AFS; i.e., job) to which the individual belongs, and (b) the Promotion Fitness Exam (PFE) a measure of general USAF knowledge covering topics such as history, customs, dress and appearance, resource management, and security. SKTs are specific to each AFS, but the PFE is given to all members of a given rank, regardless of AFS. This report provides the results of analyses conducted to address the criterion-related validity of the WAPS tests and the extent to which that validity might be reduced by repeated exposure of test content. The potential for differential item exposure effects by race/ethnicity and gender is also examined.
Document Details
- Document Type
- Technical Report
- Publication Date
- Sep 30, 2019
- Accession Number
- AD1085276
Entities
People
- Jeffrey A. Dahlke
- Kevin M. Bradley
- Martin Yu
- Matthew C. Reeder
- Rodney A. McCloy
Organizations
- Human Resources Research Organization