Assessing Leader Cognitive Skills with Situational Judgment Tests: Construct Validity Results

Abstract

The objective of this research was to provide construct validity evidence for two situational judgment tests (SJTs) that were developed to evaluate the cognitive skills of experienced Army leaders in the Maneuver Captains Career Course. Specifically, the SJTs were developed to assess two different echelons of command - company command competencies and battalion staff competencies. Results from 138 officers (primarily Captains) demonstrated that the best fitting models for both SJTs were ones in which adaptive skill and task performance were separate constructs. These findings are useful for instructors in that they provide specific guidance regarding the modules that reflect performance in either adaptive or routine decision-making contexts. Further, feedback was highly favorable due to the scenario-based nature of the questions; students felt challenged by having to apply knowledge learned throughout the course. These findings indicate that a SJT may be a practical and valid method for assessing leader adaptive and decision-making skills, especially when the data will be used to compare performance across individuals.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2010
Accession Number
ADA530102

Entities

People

  • Amanda N. Gesselman
  • Jennifer S. Tucker
  • Vanessa Johnson

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Communities of Interest

  • Biomedical
  • C4I
  • Cyber
  • Electronic Warfare
  • Human Systems
  • Weapons Technologies

DTIC Thesaurus Topics

  • Artillery
  • Attack Helicopters
  • Cognitive Systems Engineering
  • Combat Operations
  • Contingency Operations (Military)
  • Employment
  • Health Services
  • Information Operations
  • Medical Evacuation
  • Military Operations
  • Military Science
  • Personnel Management
  • Psychology
  • Rotary Wing Aircraft
  • Students
  • Unmanned Aerial Systems
  • Warfare

Readers

  • Maritime Combat Support and Expeditionary Logistics.
  • Organizational Psychology.
  • Psychometric Testing or Psychological Assessment.