Reliability of Associate Ratings of Performance Potential by Army Aviators

Abstract

The primary objectives of this study were to evaluate the inter-rater reliability of a rating form designed to select AH-1 transisition candidates and to study rater acceptance of rating forms. It was hypothesized that COBRA pilots in cavalry and assault units would demonstrate high inter-rater reliability when rating non-AH-1 qualified aviators in their units on potential for AH-1 transistion and gunship pilot duties. A variable of interest was the effect of length of rater-ratee acquaintance on inter-rater reliability (Freeberg, 1969). AH-1 qualified aviators demonstate a high degree of inter-rater reliabilty when rating AH-1 candidates in their units. Statistical reliability was higher within those units where raters and ratees had been acquainted longer. The majority (58%) of AH-1 qualified raters sampled feel that ratings by fellow aviators should be used in selecting candidates for COBRA transistion. Many raters (20%) had reservations about the use of ratings because of the influence of friendship and other personal biases. Another group felt ratings could not (8%) or might not (7%) be effective in identifying potentially successful AH-1 candidates.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 01, 1976
Accession Number
ADA076826

Entities

People

  • Robert F. Eastman
  • Robert L. Mcmullen

Organizations

  • U.S. Army Research Institute for the Behavioral and Social Sciences

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Agreements
  • Applied Psychology
  • Attack Aircraft
  • Attack Helicopters
  • Friendship
  • Helicopters
  • Instructions
  • Instructors
  • Military Research
  • New York
  • Prejudice
  • Psychology
  • Reliability
  • Social Sciences
  • Test And Evaluation
  • Transitions
  • Utility Aircraft

Fields of Study

  • Psychology

Readers

  • Ballistic Missile Meteorology
  • Psychometric Testing or Psychological Assessment.