Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
Top Cited Papers
- 21 February 2003
- journal article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 100 (5) , 2197-2202
- https://doi.org/10.1073/pnas.0437847100
Abstract
Given a dictionary D = { d k } of vectors d k , we seek to represent a signal S as a linear combination S = ∑ k γ( k ) d k , with scalar coefficients γ ( k ). In particular, we aim for the sparsest representation possible. In general, this requires a combinatorial optimization process. Previous work considered the special case where D is an overcomplete system consisting of exactly two orthobases and has shown that, under a condition of mutual incoherence of the two bases, and assuming that S has a sufficiently sparse representation, this representation is unique and can be found by solving a convex optimization problem: specifically, minimizing the ℓ 1 norm of the coefficients γ̱. In this article, we obtain parallel results in a more general setting, where the dictionary D can arise from two or several bases, frames, or even less structured systems. We sketch three applications: separating linear features from planar ones in 3D data, noncooperative multiuser encoding, and identification of over-complete independent component models.Keywords
This publication has 10 references indexed in Scilit:
- A generalized uncertainty principle and sparse representation in pairs of basesIEEE Transactions on Information Theory, 2002
- The curvelet transform for image denoisingIEEE Transactions on Image Processing, 2002
- Uncertainty principles and ideal atomic decompositionIEEE Transactions on Information Theory, 2001
- Independent Component AnalysisPublished by Wiley ,2001
- Atomic Decomposition by Basis PursuitSIAM Review, 2001
- Encrypting by Random RotationsPublished by Springer Nature ,2000
- Lapped multiple bases algorithms for still image compression without blocking effectIEEE Transactions on Image Processing, 1997
- Strictly positive definite functions on spheres in Euclidean spacesMathematics of Computation, 1996
- Matching pursuits with time-frequency dictionariesIEEE Transactions on Signal Processing, 1993
- Topics in Matrix AnalysisPublished by Cambridge University Press (CUP) ,1991