Universal Priors for Sparse Modeling(PREPRINT)

Abstract

Sparse data models, where data is assumed to be well represented as a linear combination of a few elements from a dictionary, have gained considerable attention in recent years, and their use has led to state-of-the-art results in many signal and image processing tasks. It is now well understood that the choice of the sparsity regularization term is critical in the success of such models. In this work, we use tools from information theory to propose a sparsity regularization term which has several theoretical and practical advantages over the more standard `0 or `1 ones, and which leads to improved coding performance and accuracy in reconstruction tasks. We also briefly report on further improvements obtained by imposing low mutual coherence and Gram matrix norm on the learned dictionaries.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 01, 2009
Accession Number
ADA513254

Entities

People

  • Federico Lecumberry
  • Guillermo Sapiro
  • Ignacio Ramirez

Organizations

  • University of Minnesota

Tags

Communities of Interest

  • C4I

DTIC Thesaurus Topics

  • Accuracy
  • Algorithms
  • Coefficients
  • Compressed Sensing
  • Computations
  • Dictionaries
  • Electrical Engineering
  • Estimators
  • Image Processing
  • Information Theory
  • Mathematics
  • Minnesota
  • Probability
  • Random Variables
  • Recovery
  • Standards
  • Statistics

Fields of Study

  • Computer science
  • Engineering

Readers

  • Computational Linguistics
  • Computer Vision.
  • Operations Research