Accuracy vs. Robustness: Bi-criteria Optimized Ensemble of Metamodels

Abstract

Simulation has been widely used in modeling engineering systems. A metamodel is a surrogate model used to approximate a computationally expensive simulation model. Extensive research has investigated the performance of different metamodeling techniques in terms of accuracy and/or robustness and concluded no model outperforms others across diverse problem structures. Motivated by this finding, this research proposes a bi-criteria (accuracy and robustness) optimized ensemble framework to optimally identify the contributions from each metamodel (Kriging, Support Vector Regression and Radial Basis Function), where uncertainties are modeled for evaluating robustness. Twenty-eight functions from the literature are tested. It is observed for most problems, a Pareto Frontier is obtained, while for some problems only a single point is obtained. Seven geometrical and statistical metrics are introduced to explore the relationships between the function properties and the ensemble models. It is concluded that the bi-criteria optimized ensembles render not only accurate but also robust metamodels.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2014
Accession Number
ADA617632

Entities

People

  • Can Cui
  • Jeffery D. Weir
  • Mengqi Hu
  • Teresa Wu
  • Xianghua Chu

Organizations

  • Air Force Institute of Technology

Tags

Communities of Interest

  • Energy and Power Technologies
  • Human Systems

DTIC Thesaurus Topics

  • Accuracy
  • Artificial Intelligence
  • Computers
  • Data Science
  • Engineering
  • Evolutionary Algorithms
  • Gaussian Processes
  • Industrial Engineering
  • Information Processing
  • Information Science
  • Information Systems
  • Knowledge Management
  • Optimization
  • Statistical Algorithms
  • Supervised Machine Learning
  • Surveys
  • Systems Engineering

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms