Peer Ratings: Scoring Strategy Development and Reliability Demonstration on Air Force Basic Trainees

Abstract

Peer ratings were obtained from over 27,000 Basic Trainees. An effective method was developed for scoring them by algebraically summing the positive and negative ratings. A modification of the Spearman-Brown prophecy formula was used to determine interrater reliability coefficients which were adjusted to the mean number of trainees in the flights. The peer ratings yielded uniformly high interrater reliability coefficients which indicated substantial agreement among raters. It was concluded that the method developed for norming peer ratings from different size groups was valuable and could be applied to standardize future peer ratings. Peer ratings thus show promise for performance appraisal when normed using this method.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 1980
Accession Number
ADA090325

Entities

People

  • Rodney L. Rosse
  • Walter C. Borman

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Air Force
  • Air Force Facilities
  • Air Force Personnel
  • Analysis Of Variance
  • Basic Training
  • Computer Programming
  • Data Science
  • Data Sets
  • Flight Training
  • Human Resources
  • Information Science
  • Normal Distribution
  • Personnel Selection
  • Plastic Explosives
  • Test And Evaluation
  • Trainees
  • Training

Readers

  • Calculus or Mathematical Analysis
  • Psychometric Testing or Psychological Assessment.