Consensus Based Measurement

Abstract

Developing and scoring situational judgment tests have usually required much expert opinion. A more powerful, broader, and still cost-efficient procedure for creating standards even in ill-defined domains, termed Consensus Based Measurement (CBM), allows examinee responses to be evaluated as deviations from consensus understandings implied by the response distributions of examinee samples. Evaluative data show substantial convergence between expert and examinee based standards and scores, and indicate CBM may be used to score SJTs even when expert judgments are not available to develop scoring rubrics.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2004
Accession Number
ADA432860

Entities

People

  • J. Psotka
  • P. J. Legree

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Army Operations
  • Behavior And Behavior Mechanisms
  • Convergence
  • Delphi Method
  • Information Operations
  • Judgment
  • Measurement
  • Military Research
  • Motor Skills
  • Personnel Selection
  • Psychology
  • Social Sciences
  • Standards
  • Supervisors

Readers

  • Economics
  • Psychometric Testing or Psychological Assessment.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.