Derivative Free Optimization of Complex Systems with the Use of Statistical Machine Learning Models

Abstract

This project focused on development of novel derivative free optimization methods that rely on recent techniques and models from statistical learning. The main idea of these methods is to build local models of the objective function from randomly sampled data points. This approach has many benefits, in that it allows us to construct fairly accurate models with relatively small number of samples. The key difference with the deterministic sampling approaches is that these accurate models are constructed with some high probability, but not always. Moreover, it is not known, when these models are accurate. Only the probability of an accurate model occurring is known. Under these conditions, novel convergence theory needed to be developed, which has been the focus of our research.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 12, 2015
Accession Number
ADA622645

Entities

People

  • Katya Scheinberg

Organizations

  • Lehigh University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Air Force
  • Air Force Research Laboratories
  • Algorithms
  • Complex Systems
  • Convergence
  • Department Of Defense
  • Learning
  • Machine Learning
  • Mathematical Programming
  • Models
  • Optimization
  • Probabilistic Models
  • Probability
  • Sampling
  • Scientific Research
  • Statistical Samples
  • Universities

Readers

  • Calculus or Mathematical Analysis
  • Computational Modeling and Simulation

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks