On the mathematical foundations of smoothness constraints for the determination of optical flow and for surface reconstruction
- 1 January 1991
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 13 (11) , 1105-1114
- https://doi.org/10.1109/34.103272
Abstract
Gradient-based approaches to the computation of optical flow often use a minimization technique incorporating a smoothness constraint on the optical flow field. The author derives the most general form of such a smoothness constraint that is quadratic in first derivatives of the grey-level image intensity function based on three simple assumptions about the smoothness constraint: (1) it must be expressed in a form that is independent of the choice of Cartesian coordinate system in the image: (2) it must be positive definite; and (3) it must not couple different component of the optical flow. It is shown that there are essentially only four such constraints; any smoothness constraint satisfying (1), (2), or (3) must be a linear combination of these four, possibly multiplied by certain quantities invariant under a change in the Cartesian coordinate system. Beginning with the three assumptions mentioned above, the author mathematically demonstrates that all best-known smoothness constraints appearing in the literature are special cases of this general form, and, in particular, that the 'weight matrix' introduced by H.H. Nagel is essentially (modulo invariant quantities) the only physically plausible such constraint.Keywords
This publication has 9 references indexed in Scilit:
- On the mathematical foundations of smoothness constraints for the determination of optical flow and for surface reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- IMAGE SEQUENCES—TEN (OCTAL) YEARS—FROM PHENOMENOLOGY TOWARDS A THEORETICAL FOUNDATIONInternational Journal of Pattern Recognition and Artificial Intelligence, 1988
- On the estimation of optical flow: Relations between different approaches and some new resultsArtificial Intelligence, 1987
- An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image SequencesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1986
- Rotationally symmetric operators for surface interpolationComputer Vision, Graphics, and Image Processing, 1983
- From Images to SurfacesPublished by MIT Press ,1981
- Determining optical flowArtificial Intelligence, 1981
- Theory of edge detectionProceedings of the Royal Society of London. B. Biological Sciences, 1980
- Elementary Topics in Differential GeometryPublished by Springer Nature ,1979