Can Role-Play with Virtual Humans Teach Interpersonal Skills?

Abstract

Interpersonal and counseling skills are essential to Officers' ability to lead (Headquarters, Department of the Army 2006, 2008, 2011). We developed a cognitive framework and an immersive training experience--the Immersive Naval Officer Training System (INOTS)--to help Officers learn and practice these skills. INOTS includes up-front instruction about the framework, vignette-based demonstrations of its application, a role-play session with a virtual human to practice the skills, and a guided after-action review (AAR). A critical component of any training effort is the assessment process; we conducted both formative and summative assessments of INOTS. Our formative assessments comprised surveys as well as physiological sensor equipment. Data from these instruments were used to evaluate how engaging the virtual-human based practice session was. We compared these data to a gold standard: a practice session with a live human role-player. We found that the trainees took the virtual-human practice session seriously--and that interacting with the virtual human was just as engaging as was interacting with the live human role-player. Our summative assessments comprised surveys as well as behavioral measures. We used these data to evaluate learning produced by the INOTS experience. In a pretest-posttest design, we found reliable gains in the participants' understanding of and ability to apply interpersonal skills although the limited practice with the virtual human did not provide additional immediate benefits. This paper details the development of our assessment approaches, the experimental procedures that yielded the data, and our results. We also discuss the implications of our efforts for the future design of assessments and training systems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2012
Accession Number
ADA581450

Entities

People

  • Andrea K. Webb
  • Joshua C. Poore
  • Julia C. Campbell
  • Matthew A. Trimmer
  • Matthew J. Hays
  • Teresa K. King

Organizations

  • University of Southern California

Tags

Communities of Interest

  • Biomedical

DTIC Thesaurus Topics

  • Behavioral Sciences
  • California
  • Department Of Defense
  • Doctrine
  • Education
  • Educational Psychology
  • Governments
  • Instructions
  • Instructors
  • Psychology
  • Schools
  • Simulations
  • Social Psychology
  • Standards
  • Students
  • Training
  • United States

Readers

  • Instructional Design and Training Evaluation.
  • Military Training and Readiness Simulation
  • STEM Education