Developing an Automated Scoring System to Support Soldier Assessments with the Consequences Test
Abstract
Measures of creativity, and particularly divergent thinking, such as the Consequences Test, have been shown to be good predictors of important aspects of career performance in the Army, including continuance and progression. Until recently, the requirement to have expert humans score the responses has made this test impractical to use on a large scale. Following the development of automated scoring models that can score these responses as well as expert humans, this test of creativity is being used operationally by the U.S. Army. The latest effort developed new scoring models for four additional test items, increasing the available number of test items in order to improve test security. We also developed new scoring tools to allow the Army to score these test items, along with five other test items whose scoring models were developed in an earlier project. The new scoring tools include an easy to use laptop version and a version intended for deployment on an Army server, allowing it to be integrated with other assessment programs.
Document Details
- Document Type
- Technical Report
- Publication Date
- Nov 01, 2021
- Accession Number
- AD1156477
Entities
People
- James T. Parker
- Mark C. Young
- Noelle LaVoie
- Peter J. Legree
- Robert N. Kilcullen