Using Neural Networks Within the Leaves of a Classification Tree

Abstract

Classification trees and neural networks are widely used individually, yet little is known about the effect of combining these two techniques. Earlier work has shown that using k-nearest neighbor (k-NN) inside the leaves of a tree can increase classification accuracy. Since neural networks are so powerful, we apply neural networks instead of the k-NN method inside the leaves of the tree. This thesis studies the performance of this composite classifier. It is compared to the tree-structured classifier and the neural network classifier. We use commonly available data sets in this application and compare the results to those generated by other generally used classifiers. Compared to the results of the other two classifiers in this thesis, the composite classifier always gives the lowest cross-validated misclassification error rates in these data sets. Its excellent performance tells us that it is worth further investigation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 01, 2000
Accession Number
ADA380713

Entities

People

  • Chia-sheng Chen

Organizations

  • Naval Postgraduate School

Tags

Communities of Interest

  • Autonomy
  • Human Systems
  • Materials and Manufacturing Processes

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Artificial Intelligence
  • Classification
  • Cognitive Science
  • Computer Programs
  • Computer Science
  • Data Sets
  • Databases
  • Information Science
  • Machine Learning
  • Neural Networks
  • Pattern Recognition
  • Probability
  • Statistics
  • Test Sets
  • Three Dimensional

Fields of Study

  • Computer science

Readers

  • Computational Modeling and Simulation
  • Neural Network Machine Learning.

Technology Areas

  • AI & ML
  • AI & ML - Neural Networks