Analysis of the Performance of a Parametric and Nonparametric Classification System: An Application to Feature Selection and Extraction in Radar Target Identification.

Abstract

This dissertation investigates new parametric and nonparametric bounds on the Bayes risk that can be used as a criterion in feature selection and extraction in radar target identification (RTI). For the parametric case, where the form of the underlying statistical distributions is known, Bayesian decision theory offers a well-motivated methodology for the design of parametric classifiers. This investigation provides new bounds on the Bayes risk for both simple and composite classes. Bounds on the Bayes risk for M classes are derived in terms of the risk functions for (M-1) classes, and so on until the result depends only on the Pairwise Bayes risks. When the parameters of the underlying distributions are unknown, an analysis of the effect of finite sample size and dimensionality on these bounds is given for the case of supervised learning. For the case of unsupervised learning, the parameters of these distributions are evaluated by using the maximum likelihood technique by means of an iterative method and an appropriate algorithm. Finally, for the nonparametric case, where the form of the underlying statistical distributions is unknown, a nonparametric technique, the nearest-neighbor (N N) rule, is used to provide estimated bounds on the Bayes risk. Two methods are proposed to produce a finite size risk close to the asymptotic one. The difference between the finite sample size risk and the asymptotic risk is used as the criterion of improvement.

Document Details

Document Type
Technical Report
Publication Date
May 01, 1987
Accession Number
ADA182681

Entities

People

  • A. Djouadi
  • F. D. Garber

Organizations

  • Ohio State University

Tags

DTIC Thesaurus Topics

  • Algorithms
  • Data Science
  • Decision Theory
  • Dimensionality Reduction
  • Extraction
  • Feature Selection
  • Identification
  • Information Science
  • Learning
  • Machine Learning
  • Radar Targets
  • Statistical Distributions
  • Supervised Machine Learning
  • Targets
  • Unsupervised Machine Learning

Fields of Study

  • Mathematics

Readers

  • Neural Network Machine Learning.
  • Statistical inference.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms