Work Smarter, Not Harder: Guidelines for Designing Simulation Experiments

Abstract

We present the basic concepts of experimental design, the types of goals it can address, and why it is such an important and useful tool for simulation. A well-designed experiment allows the analyst to examine many more factors than would otherwise be possible, while providing insights that could not be gleaned from trial-and-error approaches or by sampling factors one at a time. We focus on experiments that can cut down the sampling requirements of some classic designs by orders of magnitude, yet make it possible and practical to develop an understanding of a complex simulation model and gain insights into its behavior. Designs that we have found particularly useful for simulation experiments are illustrated using simple simulation models, and we provide links to other resources for those wishing to learn more. Ideally, this tutorial will leave you excited about experimental designs--and prepared to use them--in your upcoming simulation studies.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2005
Accession Number
ADA491983

Entities

People

  • Susan M. Sanchez

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Advanced Electronics
  • Energy and Power Technologies
  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • Agent-Based Simulations
  • Combinatorial Analysis
  • Data Analysis
  • Data Science
  • Experimental Design
  • Factorial Design
  • Information Operations
  • Information Science
  • Military Applications
  • New Jersey
  • New York
  • Operations Research
  • Project Management
  • Sampling
  • Simulations
  • Unmanned Vehicles

Readers

  • Computational Fluid Dynamics (CFD)
  • Educational Psychology
  • Systems Analysis and Design