A Genetic Algorithm for Variable Knot Spline Fitting via Least Squares

Abstract

In this report we shall describe a method for fitting variable knot spline models to noisy univariate data which uses a genetic algorithm to optimize over the number and location of the knots. For a fixed number of knots, the location of the knots is chosen to minimize the sum of squares error; the appropriate number of knots is determined by the adjusted GCV criterion of Luo and Wahba (1997). The objective is to find the model which minimizes RSS/df, where the degrees of freedom are inflated to reflect the adaptive nature of the knot search (i.e., selection of basis functions). We justify theoretically that our algorithm will converge to the variable knot model which optimizes the model fitting criterion, given that this model is contained in the search space. A modified bootstrap technique is used to obtain pointwise standard errors for models obtained by the GA method. Experimental results comparing the performance! of the proposed algorithm to those obtained using the non-linear optimization technique of Schwetlick and Schuetze (1995), the genetic algorithm proposed by Manela et. al. (1993), and the method of Luo and Wahba (1997) are presented. We also discuss the extension our technique to related problems.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
May 01, 1998
Accession Number
ADA358194

Entities

People

  • Jennifer L. Pittman

Organizations

  • Pennsylvania State University

Tags

Communities of Interest

  • Air Platforms
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Artificial Intelligence
  • Classification
  • Computational Science
  • Data Analysis
  • Data Mining
  • Data Science
  • Data Sets
  • Elements
  • Genetic Algorithms
  • Governments
  • Information Science
  • Linear Programming
  • Multivariate Analysis
  • Statistical Algorithms
  • Statistics

Fields of Study

  • Mathematics

Readers

  • Marine Hydrodynamics
  • Operations Research
  • Regression Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms
  • Biotechnology
  • Space
  • Space - Spacecraft Maneuvers