Adaptive robotic visual tracking: theory and experiments
- 1 March 1993
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 38 (3) , 429-445
- https://doi.org/10.1109/9.210141
Abstract
The use of a vision sensor in the feedback loop is addressed within the controlled active vision framework. Algorithms are proposed for the solution of the robotic (eye-in-hand configuration) visual tracking and servoing problem. Visual tracking is stated as a problem of combining control with computer vision. The sum-of-squared differences optical flow is used to compute the vector of discrete displacements. The displacements are fed to an adaptive controller (self-tuning regulator) that creates commands for a robot control system. The procedure is based on the online estimation of the relative distance of the target from the camera, but only partial knowledge of the relative distance is required, obviating the need for offline calibration. Three different adaptive control schemes have been implemented, both in simulation and in experiments. The computational complexity and the experimental results demonstrate that the proposed algorithms can be implemented in real time.<>Keywords
This publication has 20 references indexed in Scilit:
- Visual tracking of a moving target by a camera mounted on a robot: a combination of control and visionIEEE Transactions on Robotics and Automation, 1993
- Weighted selection of image features for resolved rate visual feedback controlIEEE Transactions on Robotics and Automation, 1991
- Real-time vision feedback for servoing robotic manipulator with self-tuning controllerIEEE Transactions on Systems, Man, and Cybernetics, 1991
- Gramians, generalized inverses, and the least-squares approximation of optical flowJournal of Visual Communication and Image Representation, 1990
- Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated cameraIEEE Transactions on Systems, Man, and Cybernetics, 1990
- Kalman filter-based algorithms for estimating depth from image sequencesInternational Journal of Computer Vision, 1989
- Spatiotemporal energy models for the perception of motionJournal of the Optical Society of America A, 1985
- Estimating three-dimensional motion parameters of a rigid planar patchIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981
- Determining optical flowArtificial Intelligence, 1981
- Theory and applications of self-tuning regulatorsAutomatica, 1977