A new look at entropy for solving linear inverse problems
- 1 July 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 45 (5) , 1565-1578
- https://doi.org/10.1109/18.771159
Abstract
Entropy-based methods are widely used for solving inverse problems, particularly when the solution is known to be positive. Here, we address linear ill-posed and noisy inverse problems of the form z=Ax+n with a general convex constraint x/spl isin/X, where X is a convex set. Although projective methods are well adapted to this context, we study alternative methods which rely highly on some "information-based" criteria. Our goal is to clarify the role played by entropy in this field, and to present a new point of view on entropy, using general tools and results coming from convex analysis. We present then a new and broad scheme for entropic-based inversion of linear-noisy inverse problems. This scheme was introduced by Navaza in 1985 in connection with a physical modeling for crystallographic applications, and further studied by Dacunha-Castelle and Gamboa (1990). Important features of this paper are: (i) a unified presentation of many well-known reconstruction criteria, (ii) proposal of new criteria for reconstruction under various prior knowledge and with various noise statistics, (iii) a description of practical inversion of data using the aforementioned criteria, and (iv) a presentation of some reconstruction results.Keywords
This publication has 33 references indexed in Scilit:
- Retrieval of atmospheric thermodynamical parameters using satellite measurements with a maximum entropy methodInverse Problems, 1996
- Generalized projections for non-negative functionsActa Mathematica Hungarica, 1995
- On two-dimensional spectral realizationIEEE Transactions on Information Theory, 1994
- Why Least Squares and Maximum Entropy? An Axiomatic Approach to Inference for Linear Inverse ProblemsThe Annals of Statistics, 1991
- An entropy concentration theorem: applications in artificial intelligence and descriptive statisticsJournal of Applied Probability, 1990
- Computationally feasible high-resolution minimum-distance procedures which extend the maximum-entropy methodInverse Problems, 1989
- The use of non-local constraints in maximum-entropy electron density reconstructionActa Crystallographica Section A Foundations of Crystallography, 1986
- MAXIMUM ENTROPY REVISITEDStatistica Neerlandica, 1984
- Minimum cross-entropy spectral analysisIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951