Surrogate Modeling of Nonlinear Dynamic Systems: A Comparative Study

Abstract

Surrogate models play a vital role in overcoming the computational challenge in designing and analyzing nonlinear dynamic systems, especially in the presence of uncertainty. This paper presents a comparative study of different surrogate modeling techniques for nonlinear dynamic systems. Four surrogate modeling methods, namely, Gaussian process (GP) regression, a long short-term memory (LSTM) network, a convolutional neural network (CNN) with LSTM (CNN-LSTM), and a CNN with bidirectional LSTM (CNN-BLSTM), are studied and compared. All these model types can predict the future behavior of dynamic systems over long periods based on training data from relatively short periods. The multi-dimensional inputs of surrogate models are organized in a nonlinear autoregressive exogenous model (NARX) scheme to enable recursive prediction over long periods, where current predictions replace inputs from the previous time window. Three numerical examples, including one mathematical example and two nonlinear engineering analysis models, are used to compare the performance of the four surrogate modeling techniques. The results show that the GP-NARX surrogate model tends to have more stable performance than the other three deep learning (DL)-based methods for the three particular examples studied. The tuning effort of GP-NARX is also much lower than its deep learning-based counterparts.

Document Details

Document Type
Pub Defense Publication
Publication Date
May 17, 2022
Source ID
10.1115/1.4054039

Entities

People

  • Chen Jiang
  • Manuel A. Vega
  • Michael D Todd
  • Ying Zhao
  • Zhen Hu

Organizations

  • Engineer Research and Development Center
  • Los Alamos National Laboratory
  • University of California, San Diego
  • University of Michigan–Dearborn

Tags

Fields of Study

  • Computer science

Readers

  • Computational Fluid Dynamics (CFD)
  • Neural Network Machine Learning.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks
  • Space