Simulation Validation Using a Non-Parametric Statistical Method

Abstract

A primary advantage to using modeling and simulation (M&S) in a test program is it can often answer test measures that, if answered using real-world data, would require unrealistically expensive, time-consuming, or complex test events. Simulation outputs, though, are only as good as the underlying assumptions and models built into the simulation. For even moderately complex simulations, it is not easy to predict the quality of simulation results based purely on the logic that if component models, theoretical component interactions, and simulation inputs are valid, then the simulation results will be as valid as the results of a real-world test event under the same conditions. Direct comparison of simulation results to real-world test data is often conducted as part of a simulation validation effort. The analyst is faced with a difficult question: has enough data been collected under these conditions to be considered a statistically significant sample for comparison with the simulation?

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2006
Accession Number
ADA497511

Entities

People

  • Brian D. Smith

Organizations

  • Air Force Operational Test and Evaluation Center

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Data Science
  • Distribution Functions
  • Goodness Of Fit Tests
  • Information Science
  • Monte Carlo Method
  • Normal Distribution
  • Probability
  • Probability Distributions
  • Random Variables
  • Simulations
  • Statistical Algorithms
  • Statistical Analysis
  • Statistical Distributions
  • Statistical Samples
  • Statistical Sampling
  • Test And Evaluation
  • Validation

Readers

  • Computational Modeling and Simulation