An Algorithm for Finding Characteristic Roots of Quasi-Triangular Markov Chains

Abstract

Numerical root finding problems are quite common in stochastic modeling. However, many solutions stop at the presentation of a probability generating function for the state probabilities. But with increasing easy access to computing power, many problems whose answers were typically left in incomplete form or for which there has been a search for alternative solution methods are currently being reexamined. The class of Markov chains whose transition matrices have quasi-triangular layouts (i.e., those having sub- or super-triangular sets of zeros) is a good case in point. They have an especially nice structure which leads to a rather concise representation for the generating functions. But the complete solution then requires the finding of roots. Fortunately, these problems can be shown to have special properties that make accurate root finding quite feasible, and we thus supply an efficient numerical procedure for solution. Keywords: Applied probability; Computational analysis; Computational probability; Markov chains; Numerical methods; Probability; Queues; Stochastic models. (jhd)

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 10, 1989
Accession Number
ADA215490

Entities

People

  • Carl M. Harris
  • Richard W. Tibbs
  • William G. Marchal

Organizations

  • George Mason University

Tags

Communities of Interest

  • Air Platforms
  • C4I
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Algorithms
  • Computer Programs
  • Convergence
  • Distribution Functions
  • Engineering
  • Equations
  • Information Systems
  • Intensity
  • Iterations
  • Markov Chains
  • Military Research
  • New York
  • Operations Research
  • Probability
  • Probability Distributions
  • Queueing Theory
  • Random Variables

Fields of Study

  • Mathematics

Readers

  • Applied Combinatorial Optimization and Logic Circuit Design.
  • Operations Research
  • Statistical inference.