A Framework for Discussing Trust in Increasingly Autonomous Systems

Abstract

We are seeing an increase in the complexity, sophistication, and interconnectedness of automation used in a variety of everyday applications from transportation to medical diagnostics. These increasingly autonomous systems depend upon software, data, and networked communications for safe, secure, and efficient operations. They must continue to function appropriately in the face of design defects, unanticipated situations, faulty/missing data, and deliberate attacks because their operational failure could have dire consequences. MITRE recognized that there was a need for a comprehensive framework for discussing trust in these increasingly autonomous systems. This framework shown in the figure on the next page was first documented in a paper presented at the Association for the Advancement of Artificial Intelligence (AAAI) 2014 Spring Symposium.1

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2017
Accession Number
AD1107967

Entities

People

  • Andrew Lacher

Organizations

  • MITRE Corporation

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Aircraft Engines
  • Artificial Intelligence
  • Automation
  • Autonomous Systems
  • Autonomy
  • Civil Aviation
  • Computers
  • Corporations
  • Engineering
  • Environment
  • Guarantees
  • Human-Machine Interaction
  • Human-Machine Systems
  • Perception
  • Social Norms
  • Transportation
  • Unmanned Vehicles

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Software Engineering.
  • Strategic Security Studies

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • Autonomy
  • Autonomy - Human-Robot Interaction