More Web Proxy on the site http://driver.im/

research-article

Registration Based on Projective Reconstruction Technique for Augmented Reality Systems

Authors:

A. Y. C. NeeAuthors Info & Claims

IEEE Transactions on Visualization and Computer Graphics, Volume 11, Issue 3

Pages 254 - 264

https://doi.org/10.1109/TVCG.2005.48

Published: 01 May 2005 Publication History

Abstract

In AR systems, registration is one of the most difficult problems currently limiting their application. In this paper, we propose a simple registration method using projective reconstruction. This method consists of two steps: embedding and tracking. Embedding involves specifying four points to build the world coordinate system on which a virtual object will be superimposed. In tracking, a projective reconstruction technique is used to track these four specified points to compute the model view transformation for augmentation. This method is simple, as only four points need to be specified at the embedding stage and the virtual object can then be easily augmented onto a real scene from a video sequence. In addition, it can be extended to a scenario using the projective matrix that has been obtained from previous registration results using the same AR system. The proposed method has three advantages: 1) It is fast because the linear least square method can be used to estimate the related matrix in the algorithm and it is not necessary to calculate the fundamental matrix in the extended case. 2) A virtual object can still be superimposed on a related area even if some parts of the specified area are occluded during the whole process. 3) This method is robust because it remains effective even when not all the reference points are detected during the whole process, as long as at least six pairs of related reference points correspondences can be found. Some experiments have been conducted to validate the performance of the proposed method.

References

[1]

H. Kato and M. Billinghurst, “Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System,” Proc. Second IEEE and ACM Int'l Workshop Augmented Reality, pp. 85-94, 1999.

Digital Library

[2]

Y.D. Seo and K.S. Hong, “Calibration-Free Augmented Reality in Perspective,” IEEE Trans. Visualization and Computer Graphics, vol. 6,no. 4, pp. 346-359, 2000.

Digital Library

[3]

S.J.D. Prince K. Xu and A.D. Cheok, “Augmented Reality Camera Tracking with Homographies,” IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 39-45, Nov./Dec. 2002.

Digital Library

[4]

G. Simon and M.O. Berger, “Pose Estimation for Planar Structure,” IEEE Computer Graphics and Applications, vol. 22,no. 6, pp. 46-453, Nov./Dec. 2002.

Digital Library

[5]

N. Kiriakos and J.R. Vallino, “Calibration-Free Augmented Reality,” IEEE Trans. Visualization and Computer Graphics, vol. 4, no. 1, pp. 1-20, Jan.-Mar. 1998.

Digital Library

[6]

R.I. Hartley, “Projective Reconstruction and Invariant from Multiple Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 10, pp. 1036-1040, Oct. 1994.

Digital Library

[7]

R. Vijaimukund J. Molineros and R. Sharma, “Interactive Evaluation of Assembly Sequence Using Augmented Reality,” IEEE Trans. Robotics and Automation, vol. 15, no. 3, pp. 435-449, 1999.

[8]

K. Satoh M. Anabuki H. Yamamoto and H. Tamura, “A Hybrid Registration Method for Outdoor Augmented Reality,” Proc. IEEE and ACM Int'l Symp. Augmented Reality, pp. 67-76, 2001.

Digital Library

[9]

J. Rekimoto, “Matrix: A Real-Time Object Identification and Registration Method for Augmented Reality,” Proc. Third Asia Pacific Conf. Computer-Human Interactions, pp. 63-68, 1998.

Digital Library

[10]

M. Rosenthal A. State J.H. Lee G. Hirota J. Ackerman K. Keller E.D. Pisano M. Jiroutek K. Muller and H. Fuchs, “Augmented Reality Guidance for Needle Biopsies: An Initial Randomized, Controlled Trial in Phantoms,” Medical Image Analysis, vol. 6, no. 3, pp. 313-320, 2002.

[11]

S. Julier M. Lanzagorta Y. Baillot L. Rosenblum and S. Feiner, “Information Filtering for Mobile Augmented Reality,” Proc. Int'l Symp. Augmented Reality 2000, pp. 3-11, 2000.

[12]

M. Utsumi, “Development for Teleoperation Underwater Grasping System in Unclear Environment,” Proc. 2002 Int'l Symp. Underwater Technology, pp. 349-353, 2002.

[13]

B. MacIntyre M. Lohse J.D. Bolter and E. Moreno, “Integrating 2-D Video Actors into 3-D Augmented-Reality Systems,” Presence, vol. 11,no. 2, pp. 189-20, 2002.

Digital Library

[14]

S. Feiner B. MacIntyre and D. Seligmann, “Knowledge-Based Augmented Reality,” Comm. ACM, vol. 36, no. 7, pp. 52-62, 1993.

Digital Library

[15]

W. Barfield K. Baird J. Shewchuk and G. Ioannou, “Applications of Wearable Computers and Augmented Reality to Manufacturing,” Fundamentals of Wearable Computers and Augmented Reality, W.nbspBarfield and T. Caudell, eds., pp. 695-724, Lawrence Erlbaum, 2001.

[16]

R.T. Azuma, “A Survey of Augmented Reality,” Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.

Digital Library

[17]

R. Azuma Y. Baillot R. Behringer S. Feiner S. Julier and B. MacIntyre, “Recent Advances in Augmented Reality,” IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47, Nov./Dec. 2001.

Digital Library

[18]

R. Behringer, “Registration for Outdoor Augmented Reality Applications Using Computer Vision Techniques and Hybrid Sensors,” Proc. Virtual Reality Ann. Int'l Symp., pp. 244-251, 1999.

Digital Library

[19]

W.A. Ho K. Nguyen and T. Lyon, “Computer Vision-Based Registration Techniques for Augmented Reality,” Proc. Intelligent Robots and Computer Vision XV, pp. 538-548, 1996.

[20]

S.J. Maybank and O. Faugeras, “A Theory of Self-Calibration of a Moving Camera,” Int'l J. Computer Vision, vol. 8, no. 2, pp. 123-151, 1992.

Digital Library

[21]

C.S. Chen C.K. Yu and Y.P. Hung, “New Calibration-Free Approach for Augmented Reality Based on Parameterized Cuboid Structure,” Proc. Seventh Int'l Conf. Computer Vision, pp. 30-37, 1999.

[22]

Z. Zhang R. Deriche O. Faugeras and Q.T. Luong, “A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry,” Artificial Intelligence J., vol. 78, pp. 87-119, 1995.

Digital Library

[23]

R.I. Hartley, “In Defense of the Eight-Point Algorithm,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp.nbsp580-593, June 1997.

Digital Library

[24]

Z. Zhang, “Determining the Epipolar Geometry and Its Uncertainty: A Review,” Int'l J. Computer Vision, vol. 27, no. 2, pp.nbsp161-198, 1998.

Digital Library

[25]

C. Harris and M. Stephens, “A Combined Corner and Edge Detector,” Proc. Second Alvey Vision Conf., pp. 189-192, 1988.

Cited By

Guan TLi LWang C(2007)Registration based on online estimation of trifocal tensors using point and line correspondencesProceedings of the 2nd international conference on Virtual reality10.5555/1770090.1770096(42-51)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1770090.1770096
Pang YYuan MNee AOng SYoucef-Toumi K(2006)A markerless registration method for augmented reality based on affine propertiesProceedings of the 7th Australasian User interface conference - Volume 5010.5555/1151758.1151760(25-32)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.5555/1151758.1151760
Yuan MOng SNee A(2006)Registration Using Natural Features for Augmented Reality SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2006.7912:4(569-580)Online publication date: 1-Jul-2006
https://dl.acm.org/doi/10.1109/TVCG.2006.79

Index Terms

Registration Based on Projective Reconstruction Technique for Augmented Reality Systems
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
    2. Image manipulation
2. Mathematics of computing
  1. Mathematical analysis
    1. Numerical analysis
      1. Computations on matrices

Recommendations

Registration using projective reconstruction for augmented reality systems
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry

In AR systems, registration is one of the most difficult problems currently limiting its applications. In this paper, we proposed a simple registration method using projective reconstruction. This method includes two steps: embedding and tracking. ...
Tracking points using projective reconstruction for augmented reality
GRAPHITE '05: Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

Natural feature tracking is a popular research topic in computer vision and has been used in Augmented Reality (AR) applications. Current natural feature trackers have two major limitations in AR applications. Firstly, the natural features may be lost ...
Registration Using Natural Features for Augmented Reality Systems

Registration is one of the most difficult problems in augmented reality (AR) systems. In this paper, a simple registration method using natural features based on the projective reconstruction technique is proposed. This method consists of two steps: ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Visualization and Computer Graphics

IEEE Transactions on Visualization and Computer Graphics Volume 11, Issue 3

May 2005

112 pages

ISSN:1077-2626

Issue’s Table of Contents

Copyright © 2005.

Publisher

IEEE Educational Activities Department

United States

Publication History

Published: 01 May 2005

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guan TLi LWang C(2007)Registration based on online estimation of trifocal tensors using point and line correspondencesProceedings of the 2nd international conference on Virtual reality10.5555/1770090.1770096(42-51)Online publication date: 22-Jul-2007
https://dl.acm.org/doi/10.5555/1770090.1770096
Pang YYuan MNee AOng SYoucef-Toumi K(2006)A markerless registration method for augmented reality based on affine propertiesProceedings of the 7th Australasian User interface conference - Volume 5010.5555/1151758.1151760(25-32)Online publication date: 1-Jan-2006
https://dl.acm.org/doi/10.5555/1151758.1151760
Yuan MOng SNee A(2006)Registration Using Natural Features for Augmented Reality SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2006.7912:4(569-580)Online publication date: 1-Jul-2006
https://dl.acm.org/doi/10.1109/TVCG.2006.79

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents