Trust in Automated Systems: The Effect of Automation Level on Trust Calibration

Abstract

Automated systems perform functions that were previously executed by a human. When using automation, the role of the human changes from operator to supervisor. For effective operation, the human must appropriately calibrate trust in the automated system. Improper trust leads to misuse and disuse of the system. The responsibilities of an automated system can be described by its level of automation. This study examined the effect of varying levels of automation and accuracy on trust calibration. Thirty participants were divided into three groups based on the system s level of automation and provided with an automated identification system. Within the Virtual Battlespace 2 environment, participants controlled the video feed of an unmanned aircraft while they identified friendly and enemy personnel on the ground. Results indicate a significant difference in the ability to correctly identify targets between levels of automation and accuracy. Participants exhibited better calibration at the management by consent level of automation and at the lower accuracy level. These findings demonstrate the necessity of continued research in the field of automation trust.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2011
Accession Number
ADA547808

Entities

People

  • James C. Walliser

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Air Platforms
  • Autonomy
  • C4I
  • Human Systems
  • Weapons Technologies

DTIC Thesaurus Topics

  • Accuracy
  • Air Force
  • Aircrafts
  • Cognition
  • Cognitive Systems Engineering
  • Control Systems
  • Human Factors Engineering
  • Human Systems Integration
  • Human-Computer Interaction
  • Human-Machine Systems
  • Identification Systems
  • Psychology
  • Reasoning
  • Unmanned Aerial Systems
  • Unmanned Aerial Vehicles
  • Unmanned Systems
  • Unmanned Vehicles

Readers

  • Aerospace Test and Evaluation
  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.

Technology Areas

  • Autonomy
  • Autonomy - Human-Robot Interaction