Performance Evaluation Trait Validation
Abstract
In this report, we present the results of a year-long study supporting the Navy's efforts to transform its existing Performance Evaluation System (PES)with an evaluation tool that has been updated to reflect current Navy values and priorities. Our team validated and refined trait and value statements (TVS)developed for rating Sailors on a variety of dimensions, including Leadership, Teamwork, Communication, Resilience, and other character strengths. In addition, our team developed rating scales for assessing Sailors future potential for performance at the next paygrade, as well as a comparative assessment tool for evaluating Sailors against their peers. We then conducted a large-scale prototyping study, which involved the development of a performance evaluation prototype instrument, recruitment of Sailors-reported-on and performance raters, and statistical analysis of the properties of the prototype instrument in particular, the measurement validity of the TVS. Using data from 606 performance raters, we find that ratings of Sailors based on past performance and future potential predict comparative assessments, with some traits (ex. Leadership) better distinguishing the top from middle performers. Few of the trait ratings distinguished among bottom performers, although such performers were relatively rare in our sample. Ratings based on past performance and future potential were correlated with one another; while they convey unique information about the Sailor-reported-on, both sets of ratings predicted workplace behaviors. We close with four concrete recommendations for action. First, we recommend amplifying the comparative assessment in future PES. Second, consider adopting ratings of future potential for developmental/coaching purposes using actionable, concrete developmental feedback.
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 01, 2022
- Accession Number
- AD1184533
Entities
People
- Erik G. Helzer
- Marigee Bacolod
Organizations
- Naval Postgraduate School