AVERAGE COST SEMI-MARKOV DECISION PROCESSES

Abstract

The Semi-Markov Decision model is considered under the criterion of long-run average cost. A new criterion, which for any policy considers the limit of the expected cost incurred during the first n transitions divided by the expected length of the first n transitions, is considered. Conditions guaranteeing that an optimal stationary (non-randomized) policy exist are then presented. It is also shown that the above criterion is equivalent to the usual one under certain conditions.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 01, 1969
Accession Number
AD0695379

Entities

People

  • Sheldon M. Ross

Organizations

  • University of California, Berkeley

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Abstracts
  • California
  • Engineering
  • Industrial Engineering
  • Markov Processes
  • Military Research
  • North Carolina
  • Operations Research
  • Probability
  • Random Variables
  • Stationary
  • Stochastic Processes
  • Transitions
  • United States
  • United States Government
  • Universities

Fields of Study

  • Mathematics

Readers

  • Mathematical Modeling and Probability Theory.