More Web Proxy on the site http://driver.im/

research-article

Occlusion registration in video-based augmented reality

Authors:

Zhigeng PanAuthors Info & Claims

VRCAI '08: Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

Article No.: 10, Pages 1 - 6

https://doi.org/10.1145/1477862.1477875

Published: 08 December 2008 Publication History

Abstract

Augmented Reality overlaps virtual objects on real world. It mixes a real and virtual world which can generate more semantic meanings than either one. To seamlessly merge virtual and real objects, model registration is an important problem. This paper provides a practical approach to do occlusion registration which is a key cue for users to understand the scene. We apply our method to Video-based Augmented Reality where detecting occlusion relationship is challenging because virtual objects are simply superimposed on images of real scenes. By estimating the dense depth of real objects from stereo, results show our approach can efficiently and correctly register virtual and real objects.

References

[1]

Bajura, M., Henry, F., and Ohbuchi, R. Merging virtual reality with the real world: Seenig ultrasound imagery within the patient. Computers and Graphics 26, 2.

Digital Library

[2]

Bimber, O., and Raskar, R. 2005. Spatial Augmented Reality Merging Real and Virtual Worlds. A. K. Peters.

Digital Library

[3]

Bogdan, M., and Peter, M. 2006. Estimation of nonlinear errors-in-variables models for computer vision applications. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 10, 1537--1552.

Digital Library

[4]

Fortin, P., and Hebert, P. 2006. Handling occlusions in realtime augmented reality: Dealing with movable real and virtual objects. In Proceedings of the Canadian Conf. on Computer and Robot Vision, 54.

Digital Library

[5]

Fuhrmann, A., Hesina, G., Faure, F., and Gervautz, M. Occlusion in collaborative augmented environments. Computers and Graphics 23, 6.

[6]

Gordon, G., Billinghurst, M., Bell, M., Woodfill, J., Kowalik, B., Erendi, A., and Tilander, J. 2002. The use of dense stereo range data in augmented reality. In Proceedings of the Mixed and Augmented Reality, 14--23.

Digital Library

[7]

Harris, C., and Stephens, M. 1988. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference, 147--152.

[8]

Hartley, R., and Zisserman, A. 2003. Multiple View Geometry in Computer Vision. Cambridge University.

Digital Library

[9]

Hayashi, K., Kato, H., and Nishida, S. 2005. Occlusion detection of real objects using contour based stereo matching. In Proceedings of the International Conf. on Augmented Tele-existence, 180--186.

Digital Library

[10]

Howard, I., and Rogers, B. 1995. Depth Perception in Seeing in Depth. Oxford University.

[11]

Kim, H., Yang, S., and Sohn, K. 2003. 3d reconstruction of stereo images for interaction between real and virtual worlds. In Proceedings of the International Symposia on Mixed Reality, 169.

Digital Library

[12]

Lepetit, V., and Berger, M. 2000. A semi-automatic method for resolving occlusion in augmented reality. In Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition, 2225--2230.

[13]

Ni, J., Nei, D., and Zhou, Y. Research of occlusion handling in augmented reality. Journal of Computer Application (in Chinese) 26, 1.

[14]

Noriega, P., Bascle, B., and Bernier, O. 2006. Local kernel color histograms for background subtration. In Proceedings of the International Conf. on Computer Vision Theory and Applications, 67--74.

[15]

Ohta, Y., Sugaya, Y., Igarashi, H., Ohtsuki, T., and Taguchi, K. 2001. Share-z: Client/server depth sensing for see-through head mounted displays. In Proceedings of the International Symposia on Mixed Reality, 64--72.

[16]

Pang, Y., Yuan, M., Nee, A., Ong, S., and Toumi, K. 2006. A markerless registration method for augmented reality based on affine properties. In Proceedings of the 7th Australasian User Interface, 25--32.

Digital Library

[17]

Swan, J., Livingston, M., Smallman, H., Brown, D., Baillot, Y., Gabbard, J., and Hix, D. 2006. A perceptual matching technique for depth judgments in optical, see-through augmented reality. In Proceedings of IEEE Virtual Reality Conference, 19--26.

Digital Library

[18]

Yokoya, N., Takemura, H., Okuma, T., and Kanbara, M. 1999. Stereo vision based video see-through mixed reality. In Proceedings of the Mixed and Augmented Reality, 85--94.

Cited By

Halder SShin YPeng YWang LDuan LSchmalenberg PQin GGao YDede EYang DRodrigues S(2024)Dual-sided transparent display enabled by polymer stabilized liquid crystals for augmented realityNature Communications10.1038/s41467-024-54109-015:1Online publication date: 11-Nov-2024
https://doi.org/10.1038/s41467-024-54109-0
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Sizintsev MMithun NChiu HSamarasekera SKumar R(2021)Long-Range Augmented Reality with Dynamic Occlusion RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310643427:11(4236-4244)Online publication date: Nov-2021
https://doi.org/10.1109/TVCG.2021.3106434
Show More Cited By

Recommendations

Resolving occlusion in augmented reality
I3D '95: Proceedings of the 1995 symposium on Interactive 3D graphics

Current state-of-the-art augmented reality systems simply overlay computer-generated visuals on the real-world imagery, for example via video or optical see-through displays. However, overlays are not effective when displaying data in three dimensions, ...
Handling occlusions in video-based augmented reality using depth information

Augmented Reality (AR) composes virtual objects with real scenes in a mixed environment where human–computer interaction has more semantic meanings. To seamlessly merge virtual objects with real scenes, correct occlusion handling is a significant ...
Stereo Reconstruction from Multiperspective Panoramas

Abstract--A new approach to computing a panoramic (360 degrees) depth map is presented in this paper. Our approach uses a large collection of images taken by a camera whose motion has been constrained to planar concentric circles. We resample regular ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '08: Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry

December 2008

223 pages

ISBN:9781605583358

DOI:10.1145/1477862

Conference Chairs:
Susanto Rahardja
Singapore
,
Enhua Wu
China
,
Program Chairs:
Daniel Thalmann
Switzerland
,
Zhiyong Huang
Singapore

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
Institute for Infocomm Research, A*STAR

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

VRCAI '08

Sponsor:

SIGGRAPH

VRCAI '08: ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry 2008

December 8 - 9, 2008

Singapore

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
403
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Halder SShin YPeng YWang LDuan LSchmalenberg PQin GGao YDede EYang DRodrigues S(2024)Dual-sided transparent display enabled by polymer stabilized liquid crystals for augmented realityNature Communications10.1038/s41467-024-54109-015:1Online publication date: 11-Nov-2024
https://doi.org/10.1038/s41467-024-54109-0
Macedo MApolinario A(2023)Occlusion Handling in Augmented Reality: Past, Present and FutureIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.311786629:2(1590-1609)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TVCG.2021.3117866
Sizintsev MMithun NChiu HSamarasekera SKumar R(2021)Long-Range Augmented Reality with Dynamic Occlusion RenderingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.310643427:11(4236-4244)Online publication date: Nov-2021
https://doi.org/10.1109/TVCG.2021.3106434
Zollmann SLanglotz TGrasset RLo WMori SRegenbrecht H(2021)Visualization Techniques in Augmented Reality: A Taxonomy, Methods and PatternsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.298624727:9(3808-3825)Online publication date: 1-Sep-2021
https://doi.org/10.1109/TVCG.2020.2986247
Fang HOng SNee A(2009)Robot Programming Using Augmented RealityProceedings of the 2009 International Conference on CyberWorlds10.1109/CW.2009.14(13-20)Online publication date: 7-Sep-2009
https://dl.acm.org/doi/10.1109/CW.2009.14

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents