Structured and Unstructured Data Sciences and Business Intelligence for Analyzing Requirements Post Mortem

Abstract

The US Navy systems may have unexpected significant cost growth for many reasons. The Office of the Chief of Naval Operations (OPNAV) manually and periodically reviews big data (structured and unstructured data) that were created within the Department of Defense requirements process to identify the programs that create excessive cost or cost growth. This research explores two questions: 1. What are the common elements of requirements that create excessive cost growth in Navy systems? 2. Assuming the elements are identified, what is the risk (likelihood and magnitude) of cost growth from common elements for both procurement and sustainment costs? We applied classic data sciences and business intelligence tools towards a more advanced artificial general intelligence framework to analyze structured and unstructured data and identify elements and factors that create excessive cost growth. We found patterns and deep causes for high cost or cost growth programs using lexical link analysis, natural language processing (NLP) tools, a semantic network analyzer, anomaly detection, and causal learning concepts. Programs with anomalous characteristics can lead to high costs or high growth. These tools provide counterfactual and drill-down discovery of the key words that explain the deep causes of cost growth. The recommendations are to apply these tools for the total benefits of analyzing Navy programs and requirements of post mortem data, towards modernizing the OPNAV's Program Budget Information System (PBIS) to become a knowledge system that can effectively learn from historical data to make better risk predictions and decisions for the future Program Objectives Memorandum (POM).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 02, 2022
Accession Number
AD1189485

Entities

People

  • Ying Zhao

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Algorithms
  • Artificial Intelligence
  • Artificial Intelligence Software
  • Causal Reasoning
  • Computer Languages
  • Data Mining
  • Data Science
  • Information Processing
  • Information Science
  • Information Systems
  • Link Analysis
  • Machine Learning
  • Named Entity Recognition
  • Natural Language Processing
  • Network Science
  • Neural Networks
  • Unsupervised Machine Learning

Readers

  • Computational Linguistics
  • Life Cycle Cost Analysis
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy