Low Sensitivity Interpolation Using Feed-Forward Neural Networks With One Hidden Layer

Abstract

It is possible to assign directly the weights of a feed-forward neural net with one hidden layer so that the network interpolates through a given set of input-output points exactly and in such a way that the sensitivity to noise at the points of interpolation is as small as desired. This is demonstrated with a constructive proof. The weight assignment for exact interpolation requires the inversion of a nonsingular matrix. If the exact interpolation requirement is relaxed, then the inversion of that matrix can be avoided. It is possible to determine weights so that the network approximately interpolates through the set of points with any desired degree of accuracy and with a sensitivity as small as desired. Both the accuracy of interpolation and the sensitivity to noise are controlled by the size of the weights in the first layer of weights. Estimates on how large these weights have to be to achieve a desired interpolation accuracy and noise sensitivity are derived. An algorithm for approximate interpolation with low sensitivity is presented and illustrated with simple examples. weight assignment, exact/approximate interpolation, low sensitivity, total derivative.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 1991
Accession Number
ADA257306

Entities

People

  • Jorge M. Martin

Organizations

  • Naval Air Weapons Station China Lake

Tags

DTIC Thesaurus Topics

  • Accuracy
  • Air Force
  • Algorithms
  • Artificial Intelligence
  • Equations
  • Errors
  • Inequalities
  • Interpolation
  • Intervals
  • Inversion
  • Military Research
  • Neural Networks
  • Notation
  • Numbers
  • Real Numbers
  • Sensitivity
  • War Colleges

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks