Reliability and Validity of Multisource Leadership Ratings at the First Unit of Assignment
Abstract
Given the emphasis on talent management within the Army, leaders need tools to help the reliably and consistently capture and assess information related to Soldier performance and development. One such tool has been developed by the U.S. Army Research Institute - the Leader Attribute Rating Application (LARA; Ingurgio et al., 2020). LARA contains rubrics that help leaders more consistently assess their Soldiers on the leadership attributes and competencies found in the Army's Leader Requirements Model (LRM). Preliminary analyses from Ingurgio et al. (2020) show promising results regarding the usability and utility of the application, along with initial evidence regarding interrater reliability for assessments made using the application and associated rubrics. This report presents further reliability evidence by examining characteristics of ratings across peers, squad leaders, team leaders, and self-ratings. In addition, de-identified Army Physical Fitness Test (APFT) and Rifle Marksmanship (RM) scores for the rated Soldiers enabled a preliminary examination of validity evidence. The results demonstrated links between the LRM ratings and the more technical performance outcomes, reflecting the importance of considering both types of performance and highlighting the value of collecting multisource data when evaluating performance, especially on something like the LRM attributes and competencies.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jan 01, 2024
- Accession Number
- AD1219546
Entities
People
- Frederick J. Diedrich
- Krista L. Ratwani
- Scott Flanagan
- Tatiana H. Toumbeva
- Victor J. Ingurgio
Organizations
- U.S. Army Research Institute for the Behavioral and Social Sciences