High-Bandwidth Tactical-Network Data Analysis in a High-Performance-Computing (HPC) Environment: Data Marshalling

Abstract

Teams from the Aberdeen Test Center and the US Army Research Laboratory collaborated to design and build a system-of-processes with a goal of reliably marshalling data from a large-scale remote tactical network field test, shuttling the data cross-country, and performing reduction and analysis. The progression of going from terabytes of raw collected field data to a data product that can be used by analysts and evaluators required coordination of people and hardware from several cross-country sites. This system-of-processes reliably worked over a 2-month time span, processing an average of 1.5 TB of raw field-collected data a day. This report describes methods, processes, and systems employed to go from raw data to a finished data product in a short time period (several days) to facilitate Army decision making on a major communications system production.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2015
Accession Number
ADA621309

Entities

People

  • James R. Adametz
  • Jordan R. Franssen
  • Joseph D. Rivera
  • Kenneth D. Renard

Organizations

  • United States Army Research Laboratory

Tags

Communities of Interest

  • Energy and Power Technologies
  • Engineered Resilient Systems
  • Space

DTIC Thesaurus Topics

  • Accumulators
  • Audio Files
  • Bandwidth
  • Computers
  • Data Analysis
  • Data Processing
  • Data Science
  • Databases
  • Environment
  • High Performance Computing
  • Information Operations
  • Information Science
  • Information Systems
  • Instrumentation
  • Military Research
  • Network Topology
  • Tactical Networks

Readers

  • Distributed Systems and Data Platform Development
  • Logistics and Supply Chain Management.
  • Systems Analysis and Design