Sparsity and Nullity: Paradigm for Analysis Dictionary Learning

Abstract

Sparse models in dictionary learning have been successfully applied in a wide variety of machine learning and computer vision problems, and have also recently emerged with increasing research interest. Another interesting related problem based on linear equality constraint, namely the sparse null space problem (SNS), first appeared in1986 and has since inspired results on sparse basis pursuit. In this paper, we investigate the relation between the SNS problem and the analysis dictionary learning problem, and show that the SNS problem plays a central role, and may be utilized to solve dictionary learning problems. Moreover, we propose an efficient algorithm of sparse null space basis pursuit, and extend it to a solution of analysis dictionary learning. Experimental results on numerical synthetic data and real-world data are further presented to validate the performance of our method.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Aug 09, 2016
Accession Number
AD1023870

Entities

People

  • Alex Bronstein
  • Hamid Krim
  • Liyi Dai
  • Xiao Bian

Organizations

  • North Carolina State University

Tags

Communities of Interest

  • Autonomy
  • Energy and Power Technologies

DTIC Thesaurus Topics

  • Abstracts
  • Algorithms
  • Applied Mathematics
  • Big Data
  • Computer Science
  • Computer Vision
  • Computers
  • Data Analysis
  • Data Sets
  • Dimensionality Reduction
  • Electrical Engineering
  • Engineering
  • Feature Extraction
  • Machine Learning
  • North Carolina
  • Numbers
  • Pattern Recognition

Fields of Study

  • Computer science

Readers

  • Distributed Systems and Data Platform Development
  • Linear Algebra
  • Rocket Propulsion.

Technology Areas

  • AI & ML
  • AI & ML - Machine Learning Algorithms
  • AI & ML - Neural Networks
  • Space