The Impact of Performance Consistency and Performance Level on Alternative Measures of Rater Accuracy.

Abstract

This report attempts to understand factors that influence raters' ability to provide accurate ratings have, on occasion, focused on static characteristics of ratees (e.g., race and gender). The present study investigated dynamic characteristIcs related to the pattern and level of performance displayed by the ratee. In a repeated measures design, 37 raters were required to rate the performance of 4 subordinates who differed from each other in the level of their performance and its consistency. It was hypothesized that performance characteristics would have differential impact on several types of performance accuracy measures. Cronbach's overall accuracy as well as two indices of accuracy based on signal detection theory, labeled classification and behavioral accuracy by Lord (1985), were compared. Results showed that characteristics of ratee performance did effect the accuracy measures differentially. Keywords: Information processing.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 1986
Accession Number
ADA167758

Entities

People

  • Daniel R. Ilgen
  • Margaret A. Youtz

Organizations

  • Michigan State University

Tags

DTIC Thesaurus Topics

  • Accuracy
  • Air Force
  • Analysis Of Variance
  • Applied Psychology
  • Cognition
  • Educational Psychology
  • False Alarms
  • Human Resources
  • Information Processing
  • Management Personnel
  • Military Research
  • Performance Appraisals
  • Personnel Management
  • Psychology
  • Social Psychology
  • Students
  • Training

Fields of Study

  • Education

Readers

  • Computational Modeling and Simulation
  • Psychometric Testing or Psychological Assessment.