Scientific multi-agent reinforcement learning for wall-models of turbulent flows

Abstract

The predictive capabilities of turbulent flow simulations, critical for aerodynamic design and weather prediction, hinge on the choice of turbulence models. The abundance of data from experiments and simulations and the advent of machine learning have provided a boost to turbulence modeling efforts. However, simulations of turbulent flows remain hindered by the inability of heuristics and supervised learning to model the near-wall dynamics. We address this challenge by introducing scientific multi-agent reinforcement learning (SciMARL) for the discovery of wall models for large-eddy simulations (LES). In SciMARL, discretization points act also as cooperating agents that learn to supply the LES closure model. The agents self-learn using limited data and generalize to extreme Reynolds numbers and previously unseen geometries. The present simulations reduce by several orders of magnitude the computational cost over fully-resolved simulations while reproducing key flow quantities. We believe that SciMARL creates unprecedented capabilities for the simulation of turbulent flows.

Document Details

Document Type
Pub Defense Publication
Publication Date
Mar 17, 2022
Source ID
10.1038/s41467-022-28957-7

Entities

People

  • H. Jane Bae
  • Petros Koumoutsakos

Organizations

  • Air Force Office of Scientific Research

Tags

Fields of Study

  • Physics

Readers

  • Computational Fluid Dynamics (CFD)
  • Distributed Systems and Data Platform Development
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks