Evaluating the Effectiveness of Artificial Intelligence Systems in Intelligence Analysis

Abstract

This research develops methodologies for understanding the mission impact of deploying artificial intelligence (AI) systems to support intelligence missions as a function of the performance achieved by the system. A two-pronged approach is pursued, with a general frame work enabling qualitative analysis and a supplemental model of a particular class of systems with quantitative results. Our results underscore the importance of critically assessing how the performance of AI systems is measured and tailoring the metrics chosen to the function the system will perform.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 2021
Accession Number
AD1146077

Entities

People

  • Christopher Ferris
  • Daniel Ish
  • Jared Ettinger

Organizations

  • RAND Corporation

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Cyber
  • Human Systems

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Bayesian Networks
  • Computational Science
  • Computer Languages
  • Computers
  • Cyberattacks
  • Detectors
  • Drone Targeting
  • Information Science
  • Information Systems
  • Intelligence Community (United States)
  • Intelligence Cycle
  • Machine Learning
  • National Security
  • Natural Language Processing
  • Neural Networks

Fields of Study

  • Computer science

Readers

  • Computational Modeling and Simulation
  • Geospatial Intelligence and Artificial Intelligence Analytics
  • Mental Health of Military Veterans with Posttraumatic Stress Disorder (PTSD): Risk Factors, Prevalence, Symptoms, and Treatment.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy