Air Force Officer Qualifying Test (AFOQT): Situational Judgment Test (SJT) Revision
Abstract
A new situational judgment test (SJT) was developed to be included in the Air Force Officer Qualifying Test (AFOQT), which is used to qualify applicants for officer commissioning and for aircrew training. The new SJT builds on the previous SJT by changing the targeted competencies, content, instructions, response format, number of items, and scoring key. This technical report summarizes the development and psychometric analyses of the new SJT. Two competencies (Communication Skills and Leading Others) were adapted from the previous SJT and two competencies (Accepting Feedback and Adaptability) were developed for the new SJT. Psychologists generated or revised SJT items, which underwent a sensitivity review. Validation efforts recruited military and non-military samples. Overall, the new SJT was relatively difficult, moderately able to differentiate between test-takers, yielded high internal consistency, and alternate forms reliability. Analyses at the response-, item-, and subtest-levels revealed small mean score subgroup differences. Compared to the previous SJT, the new SJT demonstrated improved psychometric properties. However, limitations of this effort prevented the ability to conduct test-retest reliability, criterion-related validity, and incremental validity analyses. The evidence from the current study supports the experimental use of the new SJT, though additional research is needed to support operational use.
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 01, 2022
- Accession Number
- AD1189592
Entities
People
- Amanda N. Mouton
- Andrew R. Deregla
- Kyle J. Mann
- Rusty Wilson
- Shane J. Sizemore
- Thomas R. Carretta
Organizations
- Air Force Research Laboratory