Survey and Comparative Analysis of Entropy and Relative Entropy Thresholding Techniques

Abstract

Entropy-based image thresholding has received considerable interest in recent years. Two types of entropy are generally used as thresholding criteria: Shannon's entropy and relative entropy, also known as Kullback-Leibler information distance, where the former measures uncertainty in an information source with an optimal threshold obtained by maximizing Shannon's entropy, whereas the latter measures the information discrepancy between two different sources with an optimal threshold obtained by minimizing relative entropy. Many thresholding methods have been developed for both criteria and reported in the literature. These two entropy-based thresholding criteria have been investigated and the relationship among entropy and relative entropy thresholding methods has been explored. In particular, a survey and comparative analysis is conducted among several widely used methods that include Pun and Kapur's maximum entropy, Kittler and Illingworth's minimum error thresholding, Pal and Pal's entropy thresholding and Chang et al.'s relative entropy thresholding methods. In order to objectively assess these methods, two measures, uniformity and shape, are used for performance evaluation.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Dec 01, 2006
Accession Number
ADA464347

Entities

People

  • C.-i. Chang
  • Jingxian Wang
  • P. D. Thouin
  • S.-m. Guo
  • Yongle Du

Organizations

  • University of Maryland, Baltimore

Tags

DTIC Thesaurus Topics

  • Alphabets
  • Computer Science
  • Department Of Defense
  • Electrical Engineering
  • Engineering
  • Gaussian Distributions
  • Gray Scale
  • Histograms
  • Image Processing
  • Images
  • Information Retrieval
  • Information Theory
  • Probability
  • Probability Distributions
  • Remote Sensing
  • Two Dimensional
  • Video Images

Readers

  • Adaptive Control and Estimation with Uncertainty in Dynamic Systems.
  • Fault Tolerant Diagnosis of Black and White Balloon Isolation Tests Using ¥.
  • Systems Analysis and Design