STOCHASTIC OPTIMAL CONTROL WITH IMPERFECTLY KNOWN DISTURBANCES.

Abstract

The optimal adaptive control of linear, discrete stochastic systems is studied. A method is presented for relaxing the usual assumption that the distributions of the disturbances are known. The additive white Gaussian disturbances are regarded to have fixed but unknown parameters. The basic idea is to consider the unknown parameters as random variables whose a priori probability densities are given. Applying Bayesian filtering theory, the problem solution consists of recursion equations for sequentially computing the a posteriori probability densities of these random variables based on measurements. From these a posteriori probability densities estimates can be formed. To determine the control, the expected value of a quadratic cost functional is used as a criterion function. By applying Bellman's dynamic programming approach, one obtains the exact analytical solution of the feedback control law. Based on the exact analytical solution, it is easy to study the dual aspect of the optimal control. (Author)

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 1968
Accession Number
AD0684541

Entities

People

  • Tzyh-john Tarn

Organizations

  • University of Washington

Tags

DTIC Thesaurus Topics

  • Additives (Chemicals)
  • Computer Programming
  • Dynamic Programming
  • Equations
  • Feedback
  • Filtration
  • Mathematics
  • Measurement
  • Probability
  • Probability Distributions
  • Random Variables
  • Stochastic Processes

Fields of Study

  • Mathematics

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Statistical inference.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms