Work Performance Ratings: A Meta-Analysis of Multitrait-Multimethod Studies.
Abstract
An important approach for investigating the quality of performance ratings is an analysis of their multitrait-multimethod (MTMM) properties of convergent validity, method bias, and discriminant validity. The present effort adopted a meta-analytic procedure to provide a quantitative review of the finds of MTMM studies of work performance ratings. Studies were identified for the review by means of a computer-assisted search of the business and social literature and use of the Social Science Citation Index. A code sheet and code book were developed t specify and define study characteristics that could serve as moderator variables for explaining the differences in MTMM properties. The results indicated that convergent validity was increased through using behavioral dimensions, using example-anchored scales, developing scales rather than modifying existing scales, and involving experts in the development of the rating scales. Method bias was reduced through the use of the same procedures that led to greater validity, as well as by involving raters/ratees in scale development and providing rater training. Finally, discriminant validity was increased through using scales requiring several ratings per dimension, and providing rater training. The review identified several gaps in the literature, as well as deficiencies in the reporting of methods and results. These gaps and deficiencies, together with the quantitative findings, were discussed: and specific areas were suggested for future research.
Document Details
- Document Type
- Technical Report
- Publication Date
- Dec 01, 1986
- Accession Number
- ADA174759
Entities
People
- Catherine E. Hassett
- Scott I Tannenbaum
- Terry L. Dickinson