Projective Replay Analysis: A Reflective Approach for Aligning Educational Games to their Goals

Abstract

Educational games have become an established paradigm of instructional practice; however, there is still much to be learned about how to design games to be the most beneficial for learners. An important consideration when designing an educational game is whether there is good alignment between its content goals and the instructional behaviors it makes in order to reinforce those goals. Existing methods for measuring alignment are labor intensive and use complex auditing procedures, making it difficult to define and evaluate this alignment in order to guide the educational game design process. This thesis explores a way to operationalize this concept of alignment and demonstrates an analysis technique that can help educational game designers to both measure the alignment of current educational game designs and predict the alignment of prototypes of future iterations. In my work, I explore the use of Replay Analysis, a novel technique that uses in-game replays of player sessions as a data source to support analysis. This method can be used to capture gameplay experience for the evaluation of alignment, as well as other forms of analysis. The majority of this work has been performed in the context of RumbleBlocks, an educational game that teaches basic structural stability and balance concepts to young children. Using Replay Analysis, I leveraged replay data during a formative evaluation of RumbleBlocks to highlight some misalignments the game likely possesses in how it teaches some concepts of stability to players. These results led to suggestions for several design iterations.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 2017
Accession Number
AD1180392

Entities

People

  • Erik Harpstead

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Autonomy
  • Energy and Power Technologies
  • Ground and Sea Platforms

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Cognitive Science
  • Cognitive Systems Engineering
  • Computational Science
  • Computers
  • Data Mining
  • Data Science
  • Databases
  • Educational Technology
  • Information Processing
  • Information Science
  • Language
  • Machine Learning
  • Network Science
  • Probability
  • Psychology
  • Software Development
  • Software Testing
  • Students
  • Surveys
  • Video Games

Readers

  • Economics
  • Game Theory.
  • Instructional Design and Training Evaluation.