The Effectiveness of a Rater Training Booklet in Increasing Accuracy of Performance Ratings

Abstract

This research note examines the possibility of increasing the accuracy of performance ratings through the use of an instruction booklet to train raters. The booklet focussed on the cognitive processes of raters which can lead to faulty conclusions, bias, and misperceptions, with the goal of increasing the objectivity and fairness of observations and ratings. The research utilized a between-groups post test only design. Consensus of opinion among subject matter experts provided the true score against which the subjects' ratings were compared for accuracy. The dependent measure was the absolute deviation score of each individual's rating from the true score . The results indicated no significant group differences in accuracy. This finding is discussed, and suggestions for further research are given. Keywords: Rater training; Rater Accuracy; Rater error; Subjective measurement; Performance appraisal; Performance measurement; Rating scale; Ratings.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 1988
Accession Number
ADA194723

Entities

People

  • Delane K. Garlinger

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Applied Psychology
  • Artillery
  • Cognition
  • Education
  • Instructions
  • Judgment
  • Military Education
  • Military Research
  • Military Science
  • Observation
  • Psychology
  • Stereolithography
  • Students
  • Task Forces
  • Training

Fields of Study

  • Education

Readers

  • Educational Psychology
  • Psychometric Testing or Psychological Assessment.