Analyst Performance Measures. Volume 1: Persistent Surveillance Data Processing, Storage and Retrieval
Abstract
The Air Force is seeking innovative architectures to process and store massive data sets in a flexible and open platform - with real-time, forensic and predictive analytic capabilities. The architecture and design work described herein is being developed to anticipate applications that are highly relevant for both national security and environmental defense. Characteristics of this architecture include robustness, flexibility, and scalability. To accomplish this, novel event collaboration message based architecture is proposed. This document addresses the technology, architecture, and design issues associated with the processing, storage and retrieval of large amounts of sensor data generated in rapidly expanding and changing persistent surveillance and layered sensing scenarios. Newly developed sensors for wide-area persistent staring continue to increase the size, density and frequency of data being captured. This, coupled with the ever increasing deployment of ground based sensors, requires new and innovative techniques for storing, processing, and querying the massive amounts of data being generated. This document will describe the capability to capture a deep archive of sensor data from a variety of different sensor types indexed in space and time that can be quickly and easily searched to support real-time, forensic, and anticipatory exploitation algorithms. Metadata and results generated by these algorithms can also be stored and indexed with the original sensor data to provide a rich set of data for communicating the quality level of the data as well as how much the results of the exploitation algorithms can be trusted. The data captured by this system can also be used for research, simulation and demonstration purposes.
Document Details
- Document Type
- Technical Report
- Publication Date
- Sep 01, 2011
- Accession Number
- ADA567802
Entities
People
- Ed Wasser
- Niranjan Kode
- Sanjay Boddhu
- Telford Berkey