Cyber Test Development
Abstract
Since 2008, several phases of research have been conducted to develop and evaluate the Cyber Test (formerly known as the Information and Communications Technology Literacy Test, or ICTL), which is used as a pre-enlistment assessment across the Services and has been shown to predict success in entry-level training for cyber-related military occupations. Due to the rapidly evolving nature of cyber knowledge, it is necessary to periodically reevaluate and refresh the Cyber Test item pool to maintain the tests functioning. To this end, we calibrated, equated, and screened 215 experimental items to supplement the existing Cyber Test item pool. We also revisited Cyber Test items previously approved for operational use and culled items that were at risk of becoming obsolete in the near future. We then assembled the updated pool of items into three parallel forms (or pools) from which the computerized adaptive test (CAT) algorithm will draw items. In addition, we updated the test blueprint with the assistance of cyber subject matter experts from across the Services and developed 205 new experimental items for pilot testing.
Document Details
- Document Type
- Technical Report
- Publication Date
- Sep 29, 2023
- Accession Number
- AD1213159
Entities
People
- Brenda D. Ellis
- Christopher R. Huber
- Jeffrey A. Dahlke
- Matthew Trippe
- Sean Baldwin
Organizations
- Human Resources Research Organization