Optimal Control of Markov Processes.

Abstract

The purpose of this article is to give an overview of some recent developments in optimal stochastic control theory. Broadly speaking, stochastic control theory deals with models of systems whose evolution is affected both by certain random influences and also by certain inputs chosen by a controller. The authors are concerned here only with state-space formulations of control problems in continuous time. Moreover, the authors consider only markovian control problems in which the state x sub t of the process being controlled is Markov provided the controller follows a Markov control policy. They mainly discuss the case of continuously acting control, in which at each time t a control u sub t is applied to the system.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Mar 01, 1983
Accession Number
ADA129296

Entities

People

  • Wendell Fleming

Organizations

  • Brown University

Tags

Communities of Interest

  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Air Force
  • Applied Mathematics
  • Asymptotic Series
  • Computer Programming
  • Control Theory
  • Difference Equations
  • Differential Equations
  • Diffusion
  • Dynamic Programming
  • Engineering
  • Equations
  • Markov Processes
  • Partial Differential Equations
  • Probability
  • Stochastic Control
  • Stochastic Processes
  • Time Intervals

Fields of Study

  • Mathematics

Readers

  • Control Systems Engineering.
  • Mathematical Modeling and Probability Theory.

Technology Areas

  • Space
  • Space - Spacecraft Maneuvers