Sensor Fusion and Occlusion Refinement for Tablet-Based AR
- 6 April 2005
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
This paper presents a set of technologies which enable robust, accurate, high resolution augmentation of live video, delivered via a tablet PC to which a video camera has been attached. By combining several technologies this is achieved without the use of contrived markers in the environment: An outside-in tracker observes the tablet to generate robust, low-accuracy pose estimates. An inside-out tracker running on the tablet observes the video feed from the tablet-mounted camera and provides high-accuracy pose estimates by tracking natural features in the environment. Information from both of these trackers is combined in an Extended Kalman Filter. Finally, to maximise the quality of the augmented imagery, boundaries where the real world occludes the virtual imagery are identified and another tracker is used to refine the boundaries between real and virtual imagery so that their synthesis is as convincing as possible.Keywords
This publication has 16 references indexed in Scilit:
- First steps towards handheld augmented realityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Robot vision-based registration utilizing bird's-eye view with user's viewPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Augmented reality kanji learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Herding sheep: live system for distributed augmented realityPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2004
- Resolving occlusion in augmented reality: a contour based approach without 3D reconstructionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Using texture maps to correct for optical distortion in head-mounted displaysPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- The HiBall TrackerPublished by Association for Computing Machinery (ACM) ,1999
- Resolving occlusion in augmented realityPublished by Association for Computing Machinery (ACM) ,1995
- Dynamic registration correction in video-based augmented reality systemsIEEE Computer Graphics and Applications, 1995
- Robot sensor calibration: solving AX=XB on the Euclidean groupIEEE Transactions on Robotics and Automation, 1994