The Statistical Physics of Stochastic Optimal Control and Learning

Abstract

This workshop aims to identify interconnections between the areas of statistical physics, stochastic control theory, and learning/adaptation and investigate open questions and future research directions at the intersection of these fields. The investigation will have a theoretical and an application component. Starting with connections between statistical physics and optimal control, concepts from statistical physics have recently been used towards the development of scalable algorithms for stochastic control. Grounded on the fundamental connections between partial differential equations and stochastic differential equations, the aforementioned tools provide probabilistic representations of solutions of partial differential equations and generated new algorithms for stochastic control using forward sampling of stochastic differential equations. On the other side, optimality principles in control theory namely the Pontryagin Maximum principle and Dynamic Programming have been used to generalize fluctuation theorems in stochastic thermodynamics. The use of aforementioned optimality principles has contributed towards a better understanding of the role that feedforward and feedback control laws play in stochastic thermodynamic systems. In machine learning, there have been new probabilistic methods for inference, regression and uncertainty representation. Algorithms for statistical inference have interpretations drawn from statistical physics and stochastic thermodynamics. These interpretations have the potential to result in new algorithms for statistical inference and create a direct connection between statistical physics and machine learning/adaptation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Nov 17, 2016
Accession Number
AD1064069

Entities

People

  • Evangelos A. Theodorou

Organizations

  • Georgia Tech Research Corporation

Tags

Communities of Interest

  • Autonomy
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Algorithms
  • Complex Systems
  • Computational Science
  • Control Systems
  • Control Theory
  • Differential Equations
  • Engineering
  • Equations
  • Information Processing
  • Machine Learning
  • Materials Science
  • Network Science
  • Partial Differential Equations
  • Stochastic Control
  • Students
  • Systems Engineering
  • Thermodynamics

Readers

  • Operations Research
  • Theoretical Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks