Meta-Analysis of Multiple Simulation-Based Experiments
Abstract
Computer simulations facilitate the study of real-world phenomena by providing safe, controlled, flexible, and repeatable experimental environments at costs far lower than other options. Both the validity of the simulation model and the scope of its validity determine the degree to which the findings can be generalized and applied to real-world situations and problems. In practice, no single model captures all of the important aspects of a phenomena of interest, nor is it applicable over a wide set of missions and circumstances. Thus, effectively utilizing a variety of models in a prospective meta-analysis (a set of common hypotheses and controllable variables and comparable metrics) offers the opportunity to improve validity and extend the findings to a broader range of real-world situations. NATO SAS-085, a research group exploring C2 Agility and Requisite Maturity, conceived and developed an international meta-analysis approach for studying various aspects related to C2 Agility from multiple simulation-based experiments. This paper presents the methodology they employed, which was inspired by the prospective meta-analysis domain. The challenges that arose from differences among these experiments, differences in the ways C2 Approaches were instantiated, and differences in the measures of success and in the conditions they considered are discussed.
Document Details
- Document Type
- Technical Report
- Publication Date
- Jun 01, 2013
- Accession Number
- ADA587550
Entities
People
- David S. Alberts
- Francois Bernier
- Paul Pearce
Organizations
- DRDC Valcartier