Approximations and Computational Methods for Optimal Stopping and Stochastic Impulsive Control Problems,

Abstract

The paper treats a computational method for the Optimal Stopping and Stochastic Impulsive Control problem for a diffusion. In the latter problem control acts only intermittently since there is a basic positive 'transaction' cost to be paid at each instant that the control acts. For each h > 0, a controlled Markov chain is constructed, whose continuous time interpolations are a natural approximation to the diffusion, for both the optimal stopping and impulsive control situations. The solutions to the optimal stopping and impulsive control problems for the chains are relatively easy to obtain by using standard procedures, and they converge to the solutions of the corresponding problems for the diffusion models as h nears 0.

Document Details

Document Type
Technical Report
Publication Date
Mar 01, 1975
Accession Number
ADA013183

Entities

People

  • Harold J. Kushner

Organizations

  • Brown University

Tags

DTIC Thesaurus Topics

  • Computational Fluid Dynamics
  • Computational Science
  • Diffusion
  • Fluid Dynamics
  • Fluid Mechanics
  • Interpolation
  • Markov Chains
  • Mathematical Analysis
  • Mathematics
  • Mechanics
  • Standards

Fields of Study

  • Mathematics

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Mathematical Modeling and Probability Theory.