Reinforced dynamics for enhanced sampling in large atomic and molecular systems

Abstract

A new approach for efficiently exploring the configuration space and computing the free energy of large atomic and molecular systems is proposed, motivated by an analogy with reinforcement learning. There are two major components in this new approach. Like metadynamics, it allows for an efficient exploration of the configuration space by adding an adaptively computed biasing potential to the original dynamics. Like deep reinforcement learning, this biasing potential is trained on the fly using deep neural networks, with data collected judiciously from the exploration and an uncertainty indicator from the neural network model playing the role of the reward function. Parameterization using neural networks makes it feasible to handle cases with a large set of collective variables. This has the potential advantage that selecting precisely the right set of collective variables has now become less critical for capturing the structural transformations of the system. The method is illustrated by studying the full-atom explicit solvent models of alanine dipeptide and tripeptide, as well as the system of a polyalanine-10 molecule with 20 collective variables.

Document Details

Document Type
Pub Defense Publication
Publication Date
Mar 27, 2018
Source ID
10.1063/1.5019675

Entities

People

  • Han Wang
  • Linfeng Zhang
  • Weinan E

Organizations

  • Beijing Institute of Big Data Research
  • Institute of Applied Physics and Computational Mathematics
  • Office of Naval Research
  • Princeton University
  • United States Department of Energy

Tags

Readers

  • Computational Modeling and Simulation
  • Neural Network Machine Learning.
  • Quantum spin resonance or Electron Paramagnetic Resonance spectroscopy.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks
  • Space