Dataworks 2023: Development of a Wald-Type Statistical Test to Compare Live Test Data and M and S Predictions

Abstract

This work describes the development of a statistical test created in support of ongoing verification, validation, and accreditation (VV and A) efforts for modeling and simulation (M and S) environments. The test decides between a null hypothesis of agreement between the simulation and reality, and an alternative hypothesis stating the simulation and reality do not agree. To do so, it generates a Wald-type statistic that compares the coefficients of two generalized linear models that are estimated on live test data and analogous simulated data, then determines whether any of the coefficient pairs are statistically different.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 01, 2023
Accession Number
AD1212356

Entities

People

  • Carrington A. Metts
  • Curtis G. Miller
  • Elliot A. Bartis

Organizations

  • Institute for Defense Analyses

Tags

Communities of Interest

  • Weapons Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Addressing
  • Agreements
  • Coefficients
  • Contracts
  • Countermeasures
  • Data Science
  • Department Of Defense
  • Environment
  • Governments
  • Information Science
  • Instructions
  • Numbers
  • Security
  • Simulations
  • Statistical Tests
  • Test And Evaluation
  • Undersea Warfare
  • Validation
  • Verification
  • Virginia
  • Warfare

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Enterprise Information Systems Architecture and Joint Command Capability Interoperability Support.
  • Regression Analysis.