A PRELIMINARY INVESTIGATION OF RATER DIFFERENCES IN OFFICER EFFECTIVENESS REPORTS,

Abstract

A sample of 1,790 Air Force officers was identified, each of whom had rated at least 4 different officers during 1960-1961 on the Officer Effectiveness Report (OER). The mean OERs received by these same officers during the 1956-1959 period were used in connection with the 1960-1961 OER ratings to obtain 4 difference scores for each of the 1,790 raters, which were averaged to obtain an Average Difference Score. The reliability of the Average Difference Score was estimated, and it was used as a criterion to identify rater characteristics associated with the tendency to rate consistently high or low. The conclusions of the study were that rater differences on the OER did exist and that these were related to certain other characteristics of the raters. However, neither the differences nor the relationships were great enough in magnitude to be of practical value, and it was concluded that additional research on the study of rater differences in the OER rating system was unlikely to be fruitful. (Author)

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 1965
Accession Number
AD0622340

Entities

People

  • Ernest C. Tupes
  • Margorie N. Kaplan

Tags

DTIC Thesaurus Topics

  • Air Force
  • Reliability

Fields of Study

  • Psychology

Readers

  • Psychometric Testing or Psychological Assessment.
  • Systems Analysis and Design