SEI Thoughts on AI T and E and Related Topics

Abstract

Dev/D and OT and E/Sustainment Integration: We need to consider an integrated infrastructure to connect all portions of the lifecycle to achieve continuous V and V/ATO. Changing conditions in deployed environments are driving to incremental and continuous software (and hardware) modifications after the initial ATO. Culture Change: Just saying we need to change the culture is not enough. There are some underlying premises and constructs that need to be rigorously addressed. The Operational Test culture reflects the mission, which is to conduct rigorous, objective T and E under operational conditions. How is this mission maintained in a shift-left, shared data environment? How do you shift left and still be objective? How can data from shifted-left environments be used to justify operational release? Integrate Policy and Guidance Development: Integrate DT and OT equities directly into P and G development that affects them (e.g., DoD CIO DSO guidance, SW Acquisitions Pathway guidance). For example, code maturity is a thing for DT and OT but not in DSO CIO DSO guidance. DOT and E should be more closely involved in a review and update to the DoD CIO DSO guidance on the SW Pathway. DoD Pipeline Ownership: What role if any does DT and OT play in pipeline tool selection, pipeline development and pipeline testing? Does the role of DT and OT differ if the government owns the pipeline as opposed to the contractor? DoD pipeline ownership implies that the government is implicated in the results. This effects underlying premises about what is and what is not DTs and OTs business. Specific DT and OT concern with Agile: How are the product vision and the needs of the overall stakeholder community protected in an agile development environment centered on specific customers? The drift from legacy systems has downstream implications. Recommend a more strategic approach to the integration of agile updates to mission systems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 13, 2023
Accession Number
AD1199686

Entities

People

  • Tom Longstaff

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Air Force
  • Artificial Intelligence
  • Artificial Intelligence Software
  • Computer Vision
  • Computers
  • Department Of Defense
  • Detection
  • Dimensionality Reduction
  • Engineering
  • Failure Mode And Effect Analysis
  • Machine Learning
  • Neural Networks
  • Recognition
  • Recurrent Neural Networks
  • Signal Processing
  • Software Development
  • Test And Evaluation

Readers

  • Economics
  • Enterprise Information Systems Architecture and Joint Command Capability Interoperability Support.
  • Software Engineering.