Simulation Methodologies for Transient Markov Processes: A Comparative Study Based on Multi-Echelon Repairable Item Inventory Systems,

Abstract

Consider Monte Carlo simulation of transient behavior of continuous time Markov processes with large finite state spaces. The usual event-scheduling approach is compared to four alternative approaches which do not use event lists. Variance reduction, programming effort, and storage requirements are considered. All Monte Carlo simulation programs are written in SIMSCRIPT II.5. These approaches are then compared to a deterministic method called Randomization. The four alternative Monte Carlo simulation methods are based on two dichotomies. The first concerns continuous versus discrete time; the process can be simulated directly in continuous time or the uniformized embedded discrete time Markov chain can be simulated and then analytically randomized to recover the original continuous time process. The second dichotomy concerns a table look up versus an algorithmic approach: the mean holding time and the transition distribution for the current state of the simulated process can be read from memory (requiring large memory storage) or computed (requiring more computation time).

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jan 01, 1986
Accession Number
ADA174222

Entities

People

  • Christos G. Plastiras
  • Donald Gross
  • Douglas R. Miller

Organizations

  • George Washington University

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Computations
  • Computer Programming
  • Computer Programs
  • Computers
  • Equations
  • Estimators
  • Kolmogorov Equations
  • Markov Chains
  • Markov Processes
  • Monte Carlo Method
  • Probability
  • Reliability
  • Repair Shops
  • Simulations
  • Steady State
  • Stochastic Processes

Readers

  • Computational Fluid Dynamics (CFD)
  • Mathematical Modeling and Probability Theory.
  • Regression Analysis.

Technology Areas

  • Space