Design of a Screen-Based Simulation for Training and Automated Assessment of Teamwork Skills
Abstract
The need for teamwork training is well documented, however, teaching these skills is challenging given the logistics of assembling individual team members to train in person. Drawing from serious games, teamwork literature and established team training programs, we designed two screen-based simulation modes with different interactivity to study their effectiveness in training teamwork skills. Methods: Mixed, randomized, repeated measures study with licensed healthcare providers block stratified and randomized to: Evaluation (EVAL) mode or Game-Play (GP) mode. Teamwork construct scores (leadership, communication, situation monitoring, mutual support) from an ontology-based, Bayesian Network (BN) assessment model were analyzed using analyses of variance to compare the two modes on performance across three scenarios, and on pretest and posttest quiz scores.Results:109 participants were enrolled and randomized to each game mode. Mean composite teamwork BN scores improved for successive scenarios in both modes, with EVAL scores statistically higher than GP for every teamwork construct and scenario (r=0.73, P=.000). Overall quiz scores also improved from pretest to posttest (P=.004) but the change from pre- to post-testing between modes were not significant. Conclusions: Two modes of interactivity for screen-based simulation yielded comparable learning outcomes within three scenarios. Simple online simulations may be useful to augment team training needs.
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 01, 2019
- Accession Number
- AD1094618
Entities
People
- John K Lee
- Markus Iseli
- Noreen Webb
- Randolph H. Steadman
- Rukhsana Khan
- Yue M. Huang
Organizations
- University of California