What Counts as Progress in the T and E of Autonomy?

Abstract

Organizations across the Department of Defense have recognized that autonomous systems will pose significant new test and evaluation challenges. IDA researchers have been exploring the implications of autonomy for instrumentation, facilities, measurement, and assurance case development. Dr. David Tate was invited by the Scientific Test and Analysis Techniques Center of Excellence to present at the upcoming Advances in the Test and Evaluation of Autonomy workshop. This is the briefing he presented. It lays out a framework for thinking about what kind of assurance cases for autonomous capabilities would be convincing to certification authorities, what kinds of arguments those assurance cases would use, what kinds of measurements or other evidence could support those arguments, and what kind of instrumentation or computational tools would be needed to collect that evidence. It also describes how that framework is currently being used as the basis for Defense Acquisition University online continuous learning module CLE002, Introduction to Test and Evaluation of Autonomous Systems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Oct 01, 2019
Accession Number
AD1122180

Entities

People

  • David M. Tate

Organizations

  • Institute for Defense Analyses

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Autonomous Systems
  • Autonomy
  • Department Of Defense
  • High Resolution
  • Human-Machine Systems
  • Human-Robot Interaction
  • Information Operations
  • Learning
  • Machine Learning
  • Perception
  • Physics Laboratories
  • Reasoning
  • Reinforcement Learning
  • Reliability
  • Security
  • Test And Evaluation

Readers

  • Aerospace Test and Evaluation
  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Systems Analysis and Design

Technology Areas

  • Autonomy