Adaptive Relaxation for the Steady-State Analysis of Markov Chains

Abstract

We consider a variant of the well-known Gauss-Seidel method for the solution of Markov chains in steady state. Whereas the standard algorithm visits each state exactly once per iteration in a pre-determined order, the alternative approach uses a dynamic strategy. A set of states to be visited is maintained which can grow and shrink as the computation progresses. In this manner, we hope to concentrate the computational work in those areas of the chain in which maximum improvement in the solution can be achieved. We consider the adaptive approach both as a solver in its own right and as a relaxation method within the multi-level algorithm. Experimental results show significant computational savings in both cases.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1994
Accession Number
ADA283685

Entities

People

  • Graham Horton

Tags

DTIC Thesaurus Topics

  • Algorithms
  • Computations
  • Differential Equations
  • Engineering
  • Equations
  • Errors
  • Frequency
  • Iterations
  • Markov Chains
  • Multiprocessors
  • Partial Differential Equations
  • Petri Nets
  • Probability
  • Standards
  • Steady State

Fields of Study

  • Computer science

Readers

  • Computational Fluid Dynamics (CFD)
  • Linear Algebra
  • Mathematical Modeling and Probability Theory.