Sparse Modeling with Universal Priors and Learned Incoherent Dictionaries(PREPRINT)

Abstract

Sparse data models have gained considerable attention in recent years, and their use has led to state-of-the-art results in many signal and image processing tasks. The learning of sparse models has been mostly concerned with adapting the dictionary to tasks such as classification and reconstruction, optimizing extrinsic properties of the trained dictionaries. In this work, we first propose a learning method aimed at enhancing both extrinsic and intrinsic properties of the dictionaries, such as the mutual and cumulative coherence and the Gram matrix norm, characteristics known to improve the efficiency and performance of sparse coding algorithms. We then use tools from information theory to propose a sparsity regularization term which has several desirable theoretical and practical advantages over the more standard `0 or `1 ones. These new sparse modeling components lead to improved coding performance and accuracy in reconstruction tasks.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Sep 09, 2009
Accession Number
ADA513290

Entities

People

  • Federico Lecumberry
  • Guillermo Sapiro
  • Ignacio Ramirez

Organizations

  • University of Minnesota

Tags

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Coefficients
  • Compressed Sensing
  • Computations
  • Databases
  • Dictionaries
  • Equations
  • Estimators
  • Image Processing
  • Information Theory
  • Integrals
  • Learning
  • Mathematics
  • Probability
  • Random Variables
  • Statistics

Fields of Study

  • Computer science
  • Engineering

Readers

  • Image Processing and Computer Vision.
  • Instructional Design and Training Evaluation.
  • Linear Algebra