Convergence of Best Entropy Estimates
- 1 May 1991
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 1 (2) , 191-205
- https://doi.org/10.1137/0801014
Abstract
Given a finite number of moments of an unknown density $\bar x$ on a finite measure space, the best entropy estimate—that nonnegative density x with the given moments which minimizes the Boltzmann–Shannon entropy $I(x): = \int {x\log x} $—is considered. A direct proof is given that I has the Kadec property in $L_1 $—if $y_n $ converges weakly to $\bar y$ and $I(y_n )$ converges to $I(\bar y)$, then $y_n $ converges to $\bar y$ in norm. As a corollary, it is obtained that, as the number of given moments increases, the best entropy estimates converge in $L_1 $ norm to the best entropy estimate of the limiting problem, which is simply $\bar x$ in the determined case. Furthermore, for classical moment problems on intervals with $\bar x$ strictly positive and sufficiently smooth, error bounds and uniform convergence are actually obtained.
Keywords
This publication has 15 references indexed in Scilit:
- Entropy Minimization, DAD Problems, and Doubly Stochastic KernelsJournal of Functional Analysis, 1994
- Dual Methods in Entropy Maximization. Application to Some Problems in CrystallographySIAM Journal on Optimization, 1992
- Duality Relationships for Entropy-Like Minimization ProblemsSIAM Journal on Control and Optimization, 1991
- On the convergence of moment problemsTransactions of the American Mathematical Society, 1991
- Sequences and Series in Banach SpacesPublished by Springer Nature ,1984
- Conjugate Duality and the Exponential Fourier SpectrumPublished by Springer Nature ,1983
- Spectrum analysis—A modern perspectiveProceedings of the IEEE, 1981
- Polynomials of extremal Lp-norm on the L∞-unit sphereJournal of Approximation Theory, 1976
- On the optimum rate of transmitting informationPublished by Springer Nature ,1969
- A lower bound for discrimination information in terms of variation (Corresp.)IEEE Transactions on Information Theory, 1967