A Markovian Decision Process

Abstract

The purpose of this paper is to discuss the asymptotic behavior of the sequence (f sub n(i)) generated by a nonlinear recurrence relation. This problem arises in connection with an equipment replacement problem, cf. S. Dreyfus, A Note on an Industrial Replacement Process.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Apr 18, 1957
Accession Number
AD0606367

Entities

People

  • Richard E. Bellman

Organizations

  • RAND Corporation

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Computer Programming
  • Differential Equations
  • Dynamic Programming
  • Equations
  • Inequalities
  • Inspection
  • Linear Systems
  • Microfiche
  • Notation
  • Probability
  • Sequences
  • Steady State

Fields of Study

  • Mathematics

Readers

  • Mathematical Modeling and Probability Theory.