Analyzing Iterative Training Game Design: A Multi-Method Postmortem Analysis of CYCLES Training Center and CYCLES Carnivale

Abstract

That games can be used to teach specific content has been demonstrated numerous times. However, although specific game features have been conjectured to have an impact on learning outcomes, little empirical research exists on the impact of iterative design on learning outcomes. This article analyzes two games that have been developed to train an adult audience to recognize and avoid relying on six cognitive biases (three per game) in their decision making. The games were developed iteratively and were evaluated through a series of experiments. Although the experimental manipulations did not find a significant impact of the manipulated game features on the learning outcomes, each game iteration proved more successful than its predecessors at training players. Here, we outline a mixed-methods approach to postmortem game design analysis that helps us understand what might account for the improvement across games, and to identify new variables for future experimental training game studies.

Document Details

Document Type
Pub Defense Publication
Publication Date
Aug 10, 2018
Source ID
10.3390/mti2030046

Entities

People

  • Adrienne Shaw
  • Benjamin A. Clegg
  • Brian Mckernan
  • Elizabeth Mclaren
  • Emilie Saulnier
  • James Folkestad
  • Jennifer Stromer-galley
  • Kate Kenski
  • Matthew Rhodes
  • Rosa Martey
  • Sarah N. Taylor
  • Tomek Stralkowski

Organizations

  • Intelligence Advanced Research Projects Activity

Tags

Readers

  • Computational Modeling and Simulation
  • Game Theory.
  • Systems Analysis and Design