Constrained attractor selection using deep reinforcement learning
Abstract
This study describes an approach for attractor selection (or multistability control) in nonlinear dynamical systems with constrained actuation. Attractor selection is obtained using two different deep reinforcement learning methods: (1) the cross-entropy method and (2) the deep deterministic policy gradient method. The framework and algorithms for applying these control methods are presented. Experiments were performed on a Duffing oscillator, as it is a classic nonlinear dynamical system with multiple attractors. Both methods achieve attractor selection under various control constraints. Although these methods have nearly identical success rates, the deep deterministic policy gradient method has the advantages of a high learning rate, low performance variance, and a smooth control approach. This study demonstrates the ability of two reinforcement learning approaches to achieve constrained attractor selection.
Document Details
- Document Type
- Pub Defense Publication
- Publication Date
- May 29, 2020
- Source ID
- 10.1177/1077546320930144
Entities
People
- Brian P. Mann
- James D Turner
- Xue-She Wang
Organizations
- Army Research Office
- Duke University