Predicting Team Performance through Human Behavioral Sensing and Quantitative Workflow Instrumentation

Abstract

For decades, the social sciences have provided the foundation for the study of humans interacting with systems; however, sparse, qualitative, and often subjective observations can be insufficient in capturing the complex dynamics of modern sociotechnical enterprises. Technical advances in quantitative system-level and physiological instrumentation have made possible greater objective study of human-system interactions, and joint qualitative quantitative methodologies are being developed to improve human performance characterization. In this paper we detail how these methodologies were applied to assess teams abilities to effectively discover information, collaborate, and make risk-informed decisions during serious games. Statistical models of intragame performance were developed to determine whether behaviors in specific facets of the gameplay workflow were predictive of analytical performance and games outcomes. A study of over seventy instrumented teams revealed that teams who were more effective at face-to-face communication and system interaction performed better at information discovery tasks and had more accurate game decisions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 27, 2016
Accession Number
AD1033429

Entities

People

  • Daniel Hannon
  • Kyle O'brien
  • Matthew Daggett
  • Michael Hurley

Organizations

  • Massachusetts Institute of Technology

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Case Studies
  • Communication Networks
  • Crime
  • Detection
  • Detectors
  • Human Behavior
  • Human Systems Integration
  • Human-Computer Interaction
  • Human-Machine Interaction
  • Information Theory
  • Instrumentation
  • Operations Research
  • Probability
  • Regression Analysis
  • Social Sciences
  • User Interface
  • Vehicle Tracks

Readers

  • Distributed Systems and Data Platform Development
  • Systems Analysis and Design
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.