Canonically optimum threshold detection
- 1 April 1966
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Theory
- Vol. 12 (2) , 230-243
- https://doi.org/10.1109/tit.1966.1053866
Abstract
A general canonical theory is developed for the systematic approximation of optimum, or Bayes, detection procedures in the critical limiting threshold mode of operation. The approximations to Bayes detectors introduced here are called locally optimum Bayes detectors (LOBD's) and are defined by the condition that they produce the same value of average risk and its derivative for vanishingly small input signals(theta rightarrow 0)as do the corresponding Bayes systems. The LOBD,x̂, in the binary (i.e., two-alternative cases:H_{1}, signal and noise, vs.H_{0}, noise alone) is found to be the expansion of the logarithm of the optimum or likelihood ratio (functional) formLambda, including a suitable bias term, e.g.,x̂ = log mu + B̂_{n}(theta)+theta left( frac{delta log Lambda_{n}}{delta theta} right)_{theta = 0} mbox{(1)}Suitable choices of biasBcan frequently be made so thatx̂is asymptotically as efficient asx^{ast}, the corresponding Bayes detector. The principal advantages of the LOBD are that 1) its comparative simplicity vis-à-vis the Bayes system,x^{ast}; 2) its structure can always be found, even when the structure of the Bayes system cannot be obtained explicitly; and 3) expected performance (average risk and error probabilities) can often be determined for the LOBD when such is not possible for the Bayes system. In addition, the LOBD is canonically derived, i.e., the form ofx̂, (1), is independent of the particular noise statistics and signal, structure. New results include 1) the fact that the logarithm of the likelihood ratio is the function of the received data to be approximated, 2) correlated samples (including continuous sampling on an interval), 3) structures analogous to (1) which hold for the LOBD in binary sequential detection, and 4) similar expansions of the logarithm of the likelihood ratios, etc., which are required for the LOBD in multiple alternative cases. Moreover, in the binary situation of testing for signals(S_{1})of one class against signals(S_{2})of another in noise, the LOBD - is seen to be a linearly weighted sum of characteristics like (1). To account for the effects of correlated samples and limiting distributions that do not obey the Central Limit Theorem, i.e., are not asymptotically normal (as illustrated in several of the examples), a criterion of asymptotic relative efficiency (ARE)_{theta geq 0is developed. Sufficient, and necessary and sufficient conditions on the bias and on^{theta}itself are established, which when satisfied insure that the LOBD is at least asymptotically as efficient, or equivalent to, the corresponding Bayes detector in the limit.Keywords
This publication has 5 references indexed in Scilit:
- On the asmptotic efficiency of locally optimum detectorsIEEE Transactions on Information Theory, 1961
- Likelihood Detection of Small Signals in Stationary NoiseJournal of Applied Physics, 1961
- Detection and Extraction of Signals in Noise from the Point of View of Statistical Decision Theory. IJournal of the Society for Industrial and Applied Mathematics, 1955
- Optimum sequential detection of signals in noiseIEEE Transactions on Information Theory, 1955
- The Power of Rank TestsThe Annals of Mathematical Statistics, 1953