Effects of Rating Delay and True Halo in Laboratory-Based Performance Evaluations,
Abstract
Intervals of rating delay (immediate, one-day, two-day, seven-day) and levels of true halo (i.e., the median intercorrelations among criterion scores on the performance dimensions) were examined for effects on rater errors, raters accuracy, and convergent/discriminant validity. Raters were 293 undergraduates. Relationships among rating outcomes were also examined. Interactions between delay intervals and true halo (TH) were found for Differential Elevation (DEL) accuracy, and the rater errors of Observed Halo (OH) and Restriction of Range (ROR). These interactions suggested that (a) TH was positively correlated with DEL in the one-week delay condition but not in shorter intervals, (b) with increased rating delay, the correlation between TH and OH decreased, and (c) with increased rating delay, the correlation between TH and ROR decreased. Additional analyses indicated that TH was positively correlated with and predicted convergent validity. Relationships among rater error and rater accuracy scores indicated that observed leniency, OH, and ROR were not uniformly related to accuracy in predicted directions. It was concluded that the delay intervals studied had minimal independent influences on rating outcomes and that rater 'error' measures could not in all cases serve as meaningful measures of rating inaccuracy. Levels of true halo in rated performances need to be considered as well.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 1987
- Accession Number
- ADA194438
Entities
People
- Richard S. Tallarigo
Organizations
- Air Force Institute of Technology