SEI Blog Post: 10 Benefits and 10 Challenges of Applying Large Language Models to DoD Software Acquisition

Abstract

Department of Defense (DoD) software acquisition has long been a complex and document-heavy process. Historically, many software acquisition activities, such as generating Requests for Information (RFIs), summarizing government regulations, identifying relevant commercial standards, and drafting project status updates, have required considerable human-intensive effort. However, the advent of generative artificial intelligence (AI) tools, including large language models (LLMs), offers a promising opportunity to accelerate and streamline certain aspects of the software acquisition process. Software acquisition is one of many complex mission-critical domains that may benefit from applying generative AI to augment and/or accelerate human efforts. This blog post is the first in a series dedicated to exploring how generative AI, particularly LLMs like ChatGPT-4, can enhance software acquisition activities. Below, we present 10 benefits and 10 challenges of applying LLMs to the software acquisition process and suggest specific use cases where generative AI can provide value to the software acquisition process. Our focus is on providing timely information to software acquisition professionals, including defense software developers, program managers, systems engineers, cybersecurity analysts, and other key stakeholders, who operate within challenging constraints and prioritize security and accuracy.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 2024
Accession Number
AD1225232

Entities

People

  • Douglas Schmidt
  • John Robert

Organizations

  • Carnegie Mellon University

Tags

Fields of Study

  • Computer science

Readers

  • Defense Acquisition Program Management
  • Geospatial Intelligence and Artificial Intelligence Analytics
  • Software Engineering.

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Neural Networks
  • Cyber