Modular neural networks for MAP classification of time series and the partition algorithm
- 1 January 1996
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks
- Vol. 7 (1) , 73-86
- https://doi.org/10.1109/72.478393
Abstract
We apply the partition algorithm to the problem of time-series classification. We assume that the source that generates the time series belongs to a finite set of candidate sources. Classification is based on the computation of posterior probabilities. Prediction error is used to adaptively update the posterior probability of each source. The algorithm is implemented by a hierarchical, modular, recurrent network. The bottom (partition) level of the network consists of neural modules, each one trained to predict the output of one candidate source. The top (decision) level consists of a decision module, which computes posterior probabilities and classifies the time series to the source of maximum posterior probability. The classifier network is formed from the composition of the partition and decision levels. This method applies to deterministic as well as probabilistic time series. Source switching can also be accommodated. We give some examples of application to problems of signal detection, phoneme, and enzyme classification. In conclusion, the algorithm presented here gives a systematic method for the design of modular classification networks. The method can be extended by various choices of the partition and decision components.Keywords
This publication has 23 references indexed in Scilit:
- Adaptive dynamic neural network estimatorsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Hidden control neural architecture modeling of nonlinear time varying systems and its applicationsIEEE Transactions on Neural Networks, 1993
- Bayes statistical behavior and valid generalization of pattern classifying neural networksIEEE Transactions on Neural Networks, 1991
- A neural network approach to a Bayesian statistical decision problemIEEE Transactions on Neural Networks, 1991
- Neural network classification: a Bayesian interpretationIEEE Transactions on Neural Networks, 1990
- Adaptive deconvolution of seismic signals-performance, computational analysis, parallelismIEEE Transactions on Acoustics, Speech, and Signal Processing, 1988
- An Introduction to the Application of the Theory of Probabilistic Functions of a Markov Process to Automatic Speech RecognitionBell System Technical Journal, 1983
- Computer analysis of EEG signals with parametric modelsProceedings of the IEEE, 1981
- Optimal adaptive estimation: Structure and parameter adaptionIEEE Transactions on Automatic Control, 1971
- Optimal Estimation in the Presence of Unknown ParametersIEEE Transactions on Systems Science and Cybernetics, 1969