Automated tracking and grasping of a moving object with a robotic hand-eye system
- 1 April 1993
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics and Automation
- Vol. 9 (2) , 152-165
- https://doi.org/10.1109/70.238279
Abstract
An attempt to achieve a high level of interaction between a real-time vision system capable of tracking moving objects in 3-D and a robot arm with gripper that can be used to pick up a moving object is described. The interplay of hand-eye coordination in dynamic grasping tasks such as grasping of parts on a moving conveyor system, assembly of articulated parts, or for grasping from a mobile robotic system is explored. The goal is to build an integrated sensing and actuation system that can operate in dynamic as opposed to static environments. The system built addresses three distinct problems in using robotic hand-eye coordination for grasping moving objects: fast computation of 3-D motion parameters from vision, predictive control of a moving robotic arm to track a moving object, and interception and grasping. The system operates at approximately human arm movement rates. Experimental results in which a moving model train is tracked, stably grasped, and picked up by the system are presented. The algorithms developed to relate sensing to actuation are quite general and applicable to a variety of complex robotic tasks.<>Keywords
This publication has 25 references indexed in Scilit:
- Real-time vision feedback for servoing robotic manipulator with self-tuning controllerIEEE Transactions on Systems, Man, and Cybernetics, 1991
- Adaptive image feature prediction and control for visual tracking with a hand-eye coordinated cameraIEEE Transactions on Systems, Man, and Cybernetics, 1990
- Real-time application of neural networks for sensor-based control of robots with visionIEEE Transactions on Systems, Man, and Cybernetics, 1989
- Model for the extraction of image flowJournal of the Optical Society of America A, 1987
- ‘Four-line’ method of locally estimating optic flowImage and Vision Computing, 1987
- Robot Manipulator Control under Unix RCCL: A Robot Control "C" LibraryThe International Journal of Robotics Research, 1986
- Spatiotemporal energy models for the perception of motionJournal of the Optical Society of America A, 1985
- Computation of optic flow from the motion of edge features in image sequencesImage and Vision Computing, 1984
- On the estimation of dense displacement vector fields from image sequences (abstract only)ACM SIGGRAPH Computer Graphics, 1984
- Determining optical flowArtificial Intelligence, 1981