Development of a Man-to-Man Rating Scale for Evaluating Performance.
Abstract
Over the years a continuous problem with performance rating systems has been the leniency and the non-comparability of marks assigned by different evaluators. By utilizing a computer, a method was developed which overcomes this problem. In this new method the evaluators must compare their ratees to other specific ratees (anchors) who are under other evaluators. All ratees receive their scale value based on their relative position to the anchoring points that were used by the evaluator. A trial of the method was made on ten groups, each composed of 12 students. Each group has two evaluators. The characteristics rated were Industry, Academic Ability, Judgment, and Cooperation. These were considered as relevant characteristics to the 'job' of being a student. The groups had been relatively intact for approximately one year prior to the evaluations. A comparison of the results of using the standard fitness report rating method (RAW) and the man-to-man method (MM and MMQ) revealed that the man-to-man method was superior based on certain statistical qualities. The man-to-man method resulted in a greater spread of scores and, more importantly, resulted in higher inter-rater agreement than the standard rating method. An outside cirterion of Quality Point Average was available for the 'Academic Ability' scale. Both the standard methodology and the man-to-man methodology produced rating values which were highly related to this outside criterion, .68 and .71 respectively. (Author Modified Abstract)
Document Details
- Document Type
- Technical Report
- Publication Date
- Feb 01, 1973
- Accession Number
- AD0757702
Entities
People
- Richard S. Elster
- William H. Githens
Organizations
- Naval Postgraduate School