Continuous Calibration of Trust in Automated Systems

Abstract

This report details three studies that have been conducted in order to explore user calibration of trust in automation. In the first, we discover that all-or-none thinking about automation reliability was associated with severe decreases in trust following an aid error, but high expectations for automation performance were not. In the second study, we examine predictors and outcomes of calibration of trust. We measured calibration in three different ways. We found that awareness of the aid's accuracy trajectory (whether it was getting more or less reliable over time) was a significant predictor of calibration. However, we found that none of the three measurements of calibration had strong associations with task performance or the ability to identify aid errors. We also describe the conceptual premise and design of our third and final study. This study examines the development, loss, and recovery of trust in a route planning aid in a military simulation context. The results of this study will be presented in our final report.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2014
Accession Number
ADA606748

Entities

People

  • Deborah Lee
  • Jennifer Lachapell-unnerstall
  • Kelli Huber
  • Stephanie M. Merritt

Organizations

  • University of Missouri

Tags

Communities of Interest

  • Autonomy
  • Biomedical
  • C4I
  • Space
  • Weapons Technologies

DTIC Thesaurus Topics

  • Accuracy
  • Air Force
  • Air Force Research Laboratories
  • Cognition
  • Combat Simulations
  • Control Systems
  • Factor Analysis
  • Human Factors Engineering
  • Information Processing
  • Information Science
  • Measurement
  • Psychology
  • Reliability
  • Simulations
  • Task Performance And Analysis
  • Thinking
  • Traumatic Stress Disorder

Readers

  • Fluid Dynamics.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.
  • Theoretical Analysis.