What is Your Metric Telling You?: Evaluating Classifier Calibration under Context Specific Definitions of Reliability

Abstract

An Argument for Uncertainty in Machine Learned Models.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 11, 2022
Accession Number
AD1168363

Entities

People

  • Eric Heim

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Calibration
  • Data Sets
  • Department Of Defense
  • Engineering
  • Failure Mode And Effect Analysis
  • Guarantees
  • Learning
  • Literature
  • Machine Learning
  • Materials
  • Reliability
  • Sampling
  • Software Development
  • Test And Evaluation
  • Uncertainty
  • Universities

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Neural Networks