Complex Event Processing for Content-Based Text, Image, and Video Retrieval

Abstract

This report summarizes the findings of an exploratory team of the North Atlantic Treaty Organization (NATO) Information Systems Technology panel into Content-Based Analytics (CBA). The team carried out a technical review into the current status of theoretical and practical developments of methods, tools, and techniques supporting joint exploitation of multimedia data sources. In particular, content-based information retrieval and analytics was considered as a means to allow military experts to exploit multiple data sources in a rapid fashion for sensemaking and knowledge generation. Elements included contextual understanding of complex events through computational/human processing techniques, event prediction through the automated extraction of network features, temporal trends, hidden clusters and resource flows, and the use of machine processing for automated translation, parsing, information extraction, and summarization of unstructured and semistructured data. The main conclusions of the study are that important research gaps exist in all the technical areas covered in this report. Though the research areas and developments are being advanced in the military sector and the civil sector, in particular, they remain at low levels of technical maturity for defense and security system applications. It is recommended that this NATO collaborative research effort be expanded to advance those approaches that are most pertinent to our overall aim of enhancing the contextual understanding of complex events through CBA of heterogeneous multimedia streams.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2016
Accession Number
AD1011094

Entities

People

  • Adem Y. Mlayim
  • Anne-claire Boury-brisset
  • Barbara D. Broome
  • Bhopinder K. Madahar
  • Bruce Forrester
  • Douglas Summers-stay
  • Elizabeth K. Bowman
  • Gertjan Burghouts
  • Jasper Van Huis
  • John Duselis
  • Jonathan Howe
  • Peter Kwantes
  • Raghuveer M. Rao
  • V. M. Holland

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Autonomy
  • C4I
  • Energy and Power Technologies
  • Engineered Resilient Systems

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Cognitive Science
  • Computational Science
  • Computer Languages
  • Computer Vision
  • Data Mining
  • Information Processing
  • Information Science
  • Information Systems
  • Machine Learning
  • Natural Language Processing
  • Network Science
  • Neural Networks
  • Ontologies
  • Supervised Machine Learning

Readers

  • Computer Vision.
  • Enterprise Information Systems Architecture and Joint Command Capability Interoperability Support.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Information Retrieval