Mental Models, Trust, and Reliance: Exploring the Effect of Human Perceptions on Automation Use

Abstract

Today's military increasingly uses automation to perform or augment the performance of complex tasks. Automated systems that support or even make important decisions require human operators to understand and trust automation in order to rely on it appropriately. This study examined the effect of varying degrees of information about an automated system's reliability on mental model accuracy, trust in, and reliance on automation. Forty-two participants were divided into three groups based on level of information received about the reliability of a simulated automated target detection aid. One group received little information, one group received accurate information, and one group received inaccurate information about the target detection aid's reliability. Each participant completed a series of 120 tasks in which he or she was required to identify the presence of a threat target and then decide whether to use an automated aid for assistance. Results indicate a significant difference between the groups' trust in and reliance on automation. The experimental group that received little information trusted the automation less but relied on it more. These findings, accompanied by observational data collected regarding the formation of mental models, demonstrate the necessity of continued research in the field of automation trust.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2009
Accession Number
ADA501222

Entities

People

  • Andrea M. Cassidy

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Ground and Sea Platforms
  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Aircrafts
  • Cognitive Workload
  • Computer Programming
  • Control Systems
  • Data Analysis
  • Detection
  • Human Factors Engineering
  • Human Systems Integration
  • Human-Machine Interaction
  • Human-Machine Systems
  • Information Processing
  • Psychology
  • Reliability
  • Statistical Analysis
  • Target Detection
  • Unmanned Aerial Vehicles

Fields of Study

  • Engineering
  • Psychology

Readers

  • Team-Based Human-Centered Cognitive Task Decision Making and Information Performance.