Rating Delay and Rating Outcomes in Laboratory-Based Performance Evaluations.
Abstract
Intervals of rating delay and levels of true halo were examined for relationships with rater errors, rater accuracy (Cronbach, 1955), and convergent/discriminant validity. Relationships among these rating outcomes were also examined. Delay intervals did not affect systematic distortion, convergent, or discriminant validity, but resulted in lower Differential Elevation (DEL) accuracy and higher Absolute Halo Error (AHE) after a two-day interval. Significant intercorrelations were found among measures of rater error and rater accuracy. Elevation accuracy correlated positively with Observed Halo (OH), Observed Leniency and convergent validity. DEL correlated negatively with OH and positively with Restriction of Range. Both Stereotype Accuracy and Differential Accuracy were positively related to OH and negatively related to AHE. True halo, rather than rating delay, moderated relationships between several rater errors and rater accuracy measures. It was concluded that the delay intervals studied had few strong influences on rating outcomes and that rater 'error' measures could not in all cases serve as meaningful measures of rating inaccuracy. Levels of true halo in rated performances need to be considered as well.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 1988
- Accession Number
- ADA196864
Entities
People
- Richard S. Tallarigo
Organizations
- Air Force Institute of Technology