Learning and classification of complex dynamics
- 1 January 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 22 (9) , 1016-1034
- https://doi.org/10.1109/34.877523
Abstract
Standard, exact techniques based on likelihood maximization are available for learning Auto-Regressive Process models of dynamical processes. The uncertainty of observations obtained from real sensors means that dynamics can be observed only approximately. Learning can still be achieved via 'EM-K'-Expectation-Maximization (EM) based on Kalman Filtering. This cannot handle more complex dynamics, however, involving multiple classes of motion. A problem arises also in the case of dynamical processes observed visually: background clutter arising for example, in camouflage, produces non-Gaussian observation noise. Even with a single dynamical class, non-Gaussian observations put the learning problem beyond the scope of EM-K. For those cases, we show here how 'EM-C' - based on the Condensation algorithm which propagates random 'particle-sets', can solve the learning problem. Here, learning in clutter is studied experimentally using visual observations of a hand moving over a desktop. The resulting learned dynamical model is shown to have considerable predictive value: When used as a prior for estimation of motion, the burden of computation in visual observation is significantly reduced. Multiclass dynamics are studied via visually observed juggling; plausible dynamical models have been found to emerge from the learning process, and accurate classification of motion has resulted. In practice, EM-C learning is computationally burdensome and the paper concludes with some discussion of computational complexityKeywords
This publication has 21 references indexed in Scilit:
- A state-based technique for the summarization and recognition of gesturePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Learning and classification of complex dynamicsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2000
- Statistical models of visual shape and motionPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 1998
- Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space ModelsJournal of Computational and Graphical Statistics, 1996
- A review of parametric modelling techniques for EEG analysisMedical Engineering & Physics, 1996
- Learning to track the visual motion of contoursArtificial Intelligence, 1995
- Novel approach to nonlinear/non-Gaussian Bayesian state estimationIEE Proceedings F Radar and Signal Processing, 1993
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990
- Stochastic model for boundary detectionImage and Vision Computing, 1987
- AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHMJournal of Time Series Analysis, 1982