'Obsolescence:' Evaluating an Educational Serious Game on Artificial Intelligence Impacts to Military Strategic Goals
Abstract
Artificial Intelligence (AI) threatens to bring significant disruption to all aspects of military operations. This research develops a Serious Game (SG) and assessment methodology to provide education on the mindsets required for engaging with disruptive AI technologies. The game, Obsolescence, teaches strategic-level concepts recommended to the Department of Defense (DoD) from a compilation of reports on the current and future state of AI and warfighting. The methodology for assessing the educational value of Obsolescence addresses common challenges such as subjective reporting, control groups, population sizes, and measuring abstract or high levels of learning. The games proposed educational value is tested using a pre-and post-test format against a baseline established by official sources and experts in the fields of AI and strategic planning. The assessment includes metrics based on both self-reported learning and measurements of changes to participant responses to LO-related questions post-gameplay. The experiment found a strong correlation between the measured learning and participants' self-reported learning, and both metrics confirm that Obsolescence achieves its educational goals. This research includes the steps necessary to utilize the assessment methodology and presents recommendations both for Obsolescence and for future research in the field of educational game assessment.
Document Details
- Document Type
- Technical Report
- Publication Date
- Mar 21, 2022
- Accession Number
- AD1166900
Entities
People
- Timothy C Kokotajlo
Organizations
- Air Force Institute of Technology