A Lattice-Based MRF Model for Dynamic Near-Regular Texture Tracking
- 19 March 2007
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 29 (5) , 777-792
- https://doi.org/10.1109/tpami.2007.1053
Abstract
A near-regular texture (NRT) is a geometric and photometric deformation from its regular origin - a congruent wallpaper pattern formed by 2D translations of a single tile. A dynamic NRT is an NRT under motion. Although NRTs are pervasive in man-made and natural environments, effective computational algorithms for NRTs are few. This paper addresses specific computational challenges in modeling and tracking dynamic NRTs, including ambiguous correspondences, occlusions, and drastic illumination and appearance variations. We propose a lattice-based Markov-random-field (MRF) model for dynamic NRTs in a 3D spatiotemporal space. Our model consists of a global lattice structure that characterizes the topological constraint among multiple textons and an image observation model that handles local geometry and appearance variations. Based on the proposed MRF model, we develop a tracking algorithm that utilizes belief propagation and particle filtering to effectively handle the special challenges of the dynamic NRT tracking without any assumption on the motion types or lighting conditions. We provide quantitative evaluations of the proposed method against existing tracking algorithms and demonstrate its applications in video editingKeywords
This publication has 32 references indexed in Scilit:
- Garment Motion Capture Using Color‐Coded PatternsComputer Graphics Forum, 2005
- Active Appearance Models RevisitedInternational Journal of Computer Vision, 2004
- Analysis and synthesis of textured motion: particles and wavesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Flow-based video synthesis and editingACM Transactions on Graphics, 2004
- A computational model for periodic pattern perception based on frieze and wallpaper groupsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- The template update problemPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary TopologyNeural Computation, 2001
- Texture mixing and texture movie synthesis using statistical learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2001
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Qualitative recognition of motion using temporal textureCVGIP: Image Understanding, 1992