Refining Situational Judgment Test Methods

Abstract

Situational Judgment Tests (SJTs) assess knowledge, skills, values, and attitudes. They present scenarios, which are based on real events, to be judged, understood, scaled, and interpreted by the examinee. These instruments have been used to evaluate cognitive theories and training programs, and to predict performance. This paper presents the argument that SJTs have potential to renew and reinvigorate many aspects of psychological measurement. We provide a framework to categorize the broad range of procedures and formats adopted for SJTs. The framework indicates that the psychometric range and power of SJTs might be extended by incorporating: (a) Theories and models of human cognition and performance to systematically specify the detail provided in the scenarios; (b) Likert and constructed response formats to maximize breadth of information collected for each scenario; and (c) Consensus-based scoring methods to evaluate knowledge and attitude domains associated with emerging applications.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 01, 2006
Accession Number
ADA481655

Entities

People

  • Joseph Psotka
  • Peter J. Legree

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Communities of Interest

  • Biomedical
  • Human Systems

DTIC Thesaurus Topics

  • Algorithms
  • Applied Psychology
  • Cognition
  • Human Behavior
  • Job Analysis
  • Judgment
  • Measurement
  • Military Operations
  • Motor Skills
  • New York
  • Personnel Selection
  • Psychological Phenomena And Processes
  • Psychology
  • Reasoning
  • Reliability
  • Risk
  • Standards

Readers

  • Psychometric Testing or Psychological Assessment.
  • Systems Analysis and Design