A historical perspective of spectrum estimation

Publisher Website
Google Scholar
Abstract
The prehistory of spectral estimation has its roots in ancient times with the development of the calendar and the clock. The work of Pythagoras in 600 B.C. on the laws of musical harmony found mathematical expression in the eighteenth century in terms of the wave equation. The struggle to understand the solution of the wave equation was finally resolved by Jean Baptiste Joseph de Fourier in 1807 with his introduction of the Fourier series. The Fourier theory was extended to the case of arbitrary orthogonal functions by Sturm and Liouville in 1836. The Sturm-Liouville theory led to the greatest empirical success of spectral analysis yet obtained, namely the formulation of quantum mechanics as given by Heisenberg and Schrödinger in 1925 and 1926. In 1929 John von Neumann put the spectral theory of the atom on a firm mathematical foundation in his spectral representation theorem in Hilbert space. Meanwhile, Wiener developed the mathematical theory of Brownian movement in 1923, and in 1930 he introduced generalized harmonic analysis, that is, the spectral representation of a stationary random process. The common ground of the spectral representations of von Neumann and Wiener is the Hilbert space; the von Neumann result is for a Hermitian operator, whereas the Wiener result is for a unitary operator. Thus these two spectral representations are related by the Cayley-Möbius transformation. In 1942 Wiener applied his methods to problems of prediction and filtering, and his work was interpreted and extended by Norman Levinson. Wiener in his empirical work put more emphasis on the autocorrelation function than on the power spectrum. The modern history of spectral estimation begins with the breakthrough of J.W. Tukey in 1949, which is the statistical counterpart of the breakthrough of Fourier 142 years earlier. This result made possible an active development of empirical spectral analysis by research workers in all scientific disciplines. However, spectral analysis was computationally expensive. A major computational breakthrough occurred with the publication in 1965 of the fast Fourier transform algorithm by J.S. Cooley and J.W. Tukey. The Cooley-Tukey method made it practical to do signal processing on waveforms in either the time or the frequency domain, something never practical with continuous systems. The Fourier transform became not just a theoretical description, but a tool. With the development of the fast Fourier transform the field of empirical spectral analysis grew from obscurity to importance, and is now a major discipline. Further important contributions were the introduction of maximum entropy spectral analysis by John Burg in 1967, the development of spectral windows by Emmanuel Parzen and others starting in the 1950's, the statistical work of Maurice Priestley and his school, hypothesis testing in time series analysis by Peter Whittle starting in 1951, the Box-Jenkins approach by George Box and G.M. Jenkins in 1970, and autoregressive spectral estimation and order-determining criteria by E. Parzen and H. Akaike starting in the 1960's. To these statistical contributions must be added the equally important engineering contributions to empirical spectrum analysis, which are not treated at all in this paper, but form the subject matter of the other papers in this special issue.