Capturing Intention‐based Full‐Frame Video Stabilization
- 1 October 2008
- journal article
- Published by Wiley in Computer Graphics Forum
- Vol. 27 (7) , 1805-1814
- https://doi.org/10.1111/j.1467-8659.2008.01326.x
Abstract
Annoying shaky motion is one of the significant problems in home videos, since hand shake is an unavoidable effect when capturing by using a hand‐held camcorder. Video stabilization is an important technique to solve this problem, but the stabilized videos resulting from some current methods usually have decreased resolution and are still not so stable. In this paper, we propose a robust and practical method of full‐frame video stabilization while considering user's capturing intention to remove not only the high frequency shaky motions but also the low frequency unexpected movements. To guess the user's capturing intention, we first consider the regions of interest in the video to estimate which regions or objects the user wants to capture, and then use a polyline to estimate a new stable camcorder motion path while avoiding the user's interested regions or objects being cut out. Then, we fill the dynamic and static missing areas caused by frame alignment from other frames to keep the same resolution and quality as the original video. Furthermore, we smooth the discontinuous regions by using a three‐dimensional Poisson‐based method. After the above automatic operations, a full‐frame stabilized video can be achieved and the important regions and objects can also be preserved.Keywords
This publication has 18 references indexed in Scilit:
- Re-cinematographyPublished by Association for Computing Machinery (ACM) ,2007
- Video Inpainting Under Constrained Camera MotionIEEE Transactions on Image Processing, 2007
- Visual attention detection in video sequences using spatiotemporal cuesPublished by Association for Computing Machinery (ACM) ,2006
- Structuring home video by snippet detection and pattern parsingPublished by Association for Computing Machinery (ACM) ,2004
- Poisson image editingPublished by Association for Computing Machinery (ACM) ,2003
- Probabilistic video stabilization using Kalman filtering and mosaicingPublished by SPIE-Intl Soc Optical Eng ,2003
- Object recognition from local scale-invariant featuresPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- A model of saliency-based visual attention for rapid scene analysisPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1998
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Random sample consensusCommunications of the ACM, 1981