Automatic dismantling integrating optical flow into a machine vision-controlled robot system
- 23 December 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1320-1325 vol.2
- https://doi.org/10.1109/robot.1996.506889
Abstract
In order to automatically run a dismantling task, first a workpiece has to be recognized and its pose has to be estimated. This step is solved by a model-based recognition process using the information from three stationary cameras. Our workpiece model could be extracted from CAD-data and consists of planar patches and circular features, where the circular features are suitable to model parts of connection elements like screws. Using the initial estimation of the workpiece pose we control the robot by evaluating the image sequence given by a camera mounted on the robot hand. We use a multi-level 3D tracking approach to continuously estimate the workpiece pose using an iterative extended Kalman-filter process and integrate velocity estimation based on optical flow. To provide enough computing power for real-time image processing, we combine our dedicated image processing hardware with a heterogeneous parallel computer. Our approach has been tested in numerous experiments on loosening screws with a powered screwdriver and dismantling a workpiece consisting of two blocks of different sizes connected by two screws.Keywords
This publication has 10 references indexed in Scilit:
- Active, uncalibrated visual servoingPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Robot feedback control based on stereo vision: towards calibration-free hand-eye coordinationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- An investigation on a robot system for disassembly automationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Manipulator control with image-based visual servoPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- VISUAL SERVO CONTROL OF ROBOTS USING KALMAN FILTER ESTIMATES OF ROBOT POSE RELATIVE TO WORK-PIECESWorld Scientific Series in Robotics and Intelligent Systems, 1993
- Model-based visual feedback control for a hand-eye coordinated robotic systemComputer, 1992
- Real-time vision feedback for servoing robotic manipulator with self-tuning controllerIEEE Transactions on Systems, Man, and Cybernetics, 1991
- Calibrating a mobile cameraImage and Vision Computing, 1990
- A new technique for fully autonomous and efficient 3D robotics hand/eye calibrationIEEE Transactions on Robotics and Automation, 1989
- TINA: a 3D vision system for pick and placeImage and Vision Computing, 1988