Predicting Trust in Automated Systems - An Application of TOAST

Abstract

Following Wojton's research on the Trust of Automated Systems Test (TOAST), which is designed to measure how much a human will trust an automated system, we aimed to determine how well this scale performs when not used in a military context. We found that participants who used a poorly performing automated system trusted the system less than expected when using that system on a case-by-case basis, however, those who used a high performing system trusted the system the same as they expected. Additionally, both participants who used the poorly performing system and those who used the high performing system lost a significant amount of trust after using the system on a group case basis. These results indicate that having a high-performance system is important for trust, but only when the user has the ability to decide to trust or distrust the system on a case-by-case basis.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jul 01, 2022
Accession Number
AD1207212

Entities

People

  • Caitlan A. Fealing
  • Daniel J. Porter

Organizations

  • Institute for Defense Analyses

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Abstracts
  • Accuracy
  • Artificial Intelligence
  • Automatic Pilots
  • Automation
  • Autonomous Systems
  • Computers
  • Control Systems
  • Errors
  • Human Factors Engineering
  • Human-Machine Systems
  • Human-Robot Interaction
  • Machines
  • Processing Equipment
  • Psychology
  • Robots
  • Standards
  • Statistics
  • Steady State
  • Test And Evaluation
  • Training
  • Warning Systems

Fields of Study

  • Computer science

Readers

  • Robotics and Automation.
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.