SEPARABLE MARKOVIAN DECISION PROCESSES,
Abstract
The special structure of a class of Markovian decision problems is exploited to simplify the determination of optimum policies. For certain pairs consisting of a state i and decision k, the cost c subscript i superscript k separates (c subscript i superscript k = a sub i + b sub k), while the transition probabilities p subscript ij superscript k and transition time distributions F subscript ij superscript k are independent of i. Equivalence of a second Markovian decision problem which exploits this structure is demonstrated for the discounted and averaging cases. In addition, streamlined approaches are presented for dealing directly with the original problem and a particular inventory model is further simplified. (Author)
Document Details
- Document Type
- Technical Report
- Publication Date
- Oct 01, 1967
- Accession Number
- AD0659726
Entities
People
- Eric V. Denardo
Organizations
- RAND Corporation