Enlisting AI in Course of Action Analysis as Applied to Naval Freedom of Navigation Operations

Abstract

Navy Planning Process (NPP) Course of Action (COA) analysis requires time and subject matter experts (SMEs) to function properly. Independent steamers (lone destroyers) can soon find themselves lacking time or more than 1-2 SMEs or both. Artificial Intelligence (AI) techniques implemented in real-time strategy (RTS) wargames can be applied to military wargaming to aid military decision-makers' COA analysis. Using a deep-Q network (DQN) and the ATLATL wargaming framework, I was able to train AI agents that could operate as the opposing force (OPFOR) commander at both satisfactory and near-optimal levels of performance, after less than 24 hours of training or 500000-learning steps. I also show that under 6 hours or 150000-learning steps does not result in a satisfactory AI admiral capable of playing the role as the OPFOR commander in a similarly sized freedom of navigation operation (FONOP) scenario. Applying these AI techniques can save both time onboard and time for reachback personnel. Training AI admirals as quality OPFOR commanders can enhance for NPP for the entire Navy without adding additional strain and without creating analysis paralysis. The meaningful insights and localized flashpoints revealed through hundreds of thousands of constructive operations and experienced by the crew in live simulation or simulation replays will lead to real world, combat-ready naval forces capable of deterring aggression and maintaining freedom of the seas.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 2022
Accession Number
AD1200371

Entities

People

  • John T. Ii Allen

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Autonomy
  • Engineered Resilient Systems
  • Ground and Sea Platforms
  • Human Systems

DTIC Thesaurus Topics

  • Artificial Intelligence
  • Artificial Intelligence Software
  • Automata Theory
  • Computational Science
  • Computer Languages
  • Computer Programming
  • Computer Programs
  • Computer Science
  • Computer Simulations
  • Computers
  • Department Of Defense
  • Machine Learning
  • Mathematical Models
  • Military Training
  • Neural Networks
  • Reinforcement Learning
  • Schools
  • Students
  • United States
  • War Games

Readers

  • Geospatial Intelligence and Artificial Intelligence Analytics
  • Military Training and Readiness Simulation
  • Strategic Security Studies

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Neural Networks