Detection and Interpretation of Low-Level and High-Level Surprising and Important Events in Large-Scale Data Streams

Abstract

This project explored how to mathematically formalize the computations of surprise and relevance of events in large data streams, including video, audio and text. We have developed new mathematical theories to define surprise in terms of how new data observations may or not affect an observerÕs set of beliefs. This is computed in terms of the Kullback-Leibler divergence between posterior and prior beliefs of the observer, and quantified in a new unit of ÒwowsÓ. Likewise, we have developed a new general theory of relevance that quantifies how new data observations may or not affect an observerÕs beliefs about how she/he/it will achieve its goals. Data observations which suggest that some previously possible solutions to a problem are now invalid will be measured as more relevant, in a new unit of ÒrelsÓ. Both theories have been extensively tested using large video (~3000 hours) and text (twitter feeds) datasets.

Document Details

Document Type
DoD Grant Award
Publication Date
Jun 25, 2021
Source ID
W911NF1210433

Entities

People

  • Laurent Itti

Organizations

  • Army Contracting Command
  • United States Army
  • University of Southern California

Tags

Fields of Study

  • Physics

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Artificial Intelligence
  • Neural Network Machine Learning.