AN ASYMPTOTIC ANALYSIS OF THE NEAREST-NEIGHBOR DECISION RULE.

Abstract

The nearest-neighbor decision rule (NN rule) assigns to an unclassified sample the classification of the nearest of n previously classified samples. In a large sample analysis it is shown, under very weak regularity conditions, that the risk incurred by this nonparametric rule is less than twice the Bayes risk. A variety of standard decision problems are treated, and in some cases the bounds given on the NN risk are the best possible. The natural extension of the NN rule to the decision rule that considers several nearby neighbors and takes a vote is also treated. Consideration is given to some of the implementation problems arising in connection with the NN rule. In particular, a method of optical computation is suggested to carry out the necessary calculations and a performance-feedback technique is proposed to determine sample-size requirements. (Author)

Document Details

Document Type
Technical Report
Publication Date
May 01, 1966
Accession Number
AD0806836

Entities

People

  • Peter E. Hart

Organizations

  • Stanford University

Tags

Communities of Interest

  • Human Systems

DTIC Thesaurus Topics

  • Classification
  • Computations
  • Feedback
  • Standards

Fields of Study

  • Mathematics

Readers

  • Neural Network Machine Learning.
  • Statistical inference.