More Web Proxy on the site http://driver.im/

short-paper

Efficient pose tracking from natural features in standard web browsers

Authors:

Jens GrubertAuthors Info & Claims

Web3D '18: Proceedings of the 23rd International ACM Conference on 3D Web Technology

Article No.: 17, Pages 1 - 4

https://doi.org/10.1145/3208806.3208815

Published: 20 June 2018 Publication History

Abstract

Computer Vision-based natural feature tracking is at the core of modern Augmented Reality applications. Still, Web-based Augmented Reality typically relies on location-based sensing (using GPS and orientation sensors) or marker-based approaches to solve the pose estimation problem.

We present an implementation and evaluation of an efficient natural feature tracking pipeline for standard Web browsers using HTML5 and WebAssembly. Our system can track image targets at real-time frame rates tablet PCs (up to 60 Hz) and smartphones (up to 25 Hz).

Supplementary Material

MP4 File (a17-gottl.mp4)

Download
7.52 MB

References

[1]

Sangchul Ahn, Heedong Ko, and Steven Feiner. 2013. Webizing mobile AR contents. In Virtual Reality (VR), 2013 IEEE. IEEE, 131--132.

[2]

Sangchul Ahn, Heedong Ko, and Byounghyun Yoo. 2014. Webizing mobile augmented reality content. New Review of Hypermedia and Multimedia 20, 1 (2014), 79--100.

Digital Library

[3]

Awe.media. 2017. Bring your images to life. https://awe.media/blog/bring-your-images-to-life. (2017). Accessed: 2018-03-02.

[4]

Jerome Etienne. 2017. AR.js - Efficient Augmented Reality for the Web. https://github.com/jeromeetienne/AR.js. (2017). Accessed: 2018-03-02.

[5]

Google. 2017a. Quickstart for AR on the Web. https://developers.google.com/ar/develop/web/quickstart. (2017). Accessed: 2018-03-02.

[6]

Google. 2017b. WebARonARKit. https://github.com/google-ar/WebARonARKit. (2017). Accessed: 2018-04-22.

[7]

Immersive Web Community Group. 2018. WebXR Device API. https://immersive-web.github.io/webxr/. (2018). Accessed: 2018-04-22.

[8]

Jens Grubert, Eyal Ofek, Michel Pahud, Matthias Kranz, and Dieter Schmalstieg. 2016. Glasshands: Interaction around unmodified mobile devices using sunglasses. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ACM, 215--224.

Digital Library

[9]

Andreas Hartl, Jens Grubert, Dieter Schmalstieg, and Gerhard Reitmayr. 2013. Mobile interactive hologram verification. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 75--82.

[10]

Alex Hill, Blair MacIntyre, Maribeth Gandy, Brian Davidson, and Hafez Rouzati. 2010. Kharma: An open kml/html architecture for mobile augmented reality applications. In Mixed and Augmented Reality (ISMAR), 2010 9th IEEE International Symposium on. IEEE, 233--234.

[11]

Rob Kooper and Blair MacIntyre. 2003. Browsing the real-world wide web: Maintaining awareness of virtual information in an AR information space. International Journal of Human-Computer Interaction 16, 3 (2003), 425--446.

[12]

Tobias Langlotz, Jens Grubert, and Raphael Grasset. 2013. Augmented reality browsers: essential products or only gadgets? Commun. ACM 56, 11 (2013), 34--36.

Digital Library

[13]

Tobias Langlotz, Thanh Nguyen, Dieter Schmalstieg, and Raphael Grasset. 2014. Next-generation augmented reality browsers: rich, seamless, and adaptive. Proc. IEEE 102, 2 (2014), 155--169.

[14]

Martin Lechner. 2013. ARML 2.0 in the context of existing AR data formats. In Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), 2013 6th Workshop on. IEEE, 41--47.

[15]

Martin Lechner and Markus Tripp. 2010. ARML - an augmented reality standard. coordinates 13, 47.797222 (2010), 432--440.

[16]

Teemu Leppänen, Arto Heikkinen, Antti Karhu, Erkki Harjula, Jukka Riekki, and Timo Koskela. 2014. Augmented reality web applications with mobile agents in the internet of things. In Next Generation Mobile Apps, Services and Technologies (NGMAST), 2014 Eighth International Conference on. IEEE, 54--59.

Digital Library

[17]

Blair MacIntyre, Alex Hill, Hafez Rouzati, Maribeth Gandy, and Brian Davidson. 2011. The Argon AR Web Browser and standards-based AR application environment. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on. IEEE, 65--74.

Digital Library

[18]

Marius Muja and David G Lowe. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP (1) 2, 331--340 (2009), 2.

[19]

Lyndon JB Nixon, Jens Grubert, Gerhard Reitmayr, and James Scicluna. 2012. SmartReality: Integrating the Web into Augmented Reality. In I-SEMANTICS (Posters & Demos). Citeseer, 48--54.

[20]

Christoph Oberhofer, Jens Grubert, and Gerhard Reitmayr. 2012. Natural feature tracking in javascript. In Virtual Reality Short Papers and Posters (VRW), 2012 IEEE. IEEE, 113--114.

Digital Library

[21]

Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. 2011. ORB: An efficient alternative to SIFT or SURF. In Computer Vision (ICCV), 2011 IEEE international conference on. IEEE, 2564--2571.

Digital Library

[22]

Fernando Sambinelli and Cecilia Sosa Arias. 2015. Augmented Reality Browsers: A Proposal for Architectural Standardization. International Journal of Software Engineering & Applications 6, 1 (2015), 1.

[23]

Gheric Speiginer, Blair MacIntyre, Jay Bolter, Hafez Rouzati, Amy Lambeth, Laura Levy, Laurie Baird, Maribeth Gandy, Matt Sanders, Brian Davidson, et al. 2015. The evolution of the argon web framework through its use creating cultural heritage and community-based augmented reality applications. In International Conference on Human-Computer Interaction. Springer, 112--124.

[24]

Bruce H Thomas. 2012. A survey of visual, mixed, and augmented reality gaming. Computers in Entertainment (CIE) 10, 1 (2012), 3.

Digital Library

[25]

Daniel Wagner, Gerhard Reitmayr, Alessandro Mulloni, Tom Drummond, and Dieter Schmalstieg. 2008. Pose tracking from natural features on mobile phones. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE Computer Society, 125--134.

Digital Library

[26]

Daniel Wagner, Gerhard Reitmayr, Alessandro Mulloni, Tom Drummond, and Dieter Schmalstieg. 2010. Real-time detection and tracking for augmented reality on mobile phones. IEEE transactions on visualization and computer graphics 16, 3 (2010), 355--368.

Digital Library

Cited By

Liu KWu NHan BMontpetit MLeivadeas AUhlig SJaved M(2023)Demystifying Web-based Mobile Extended Reality Accelerated by WebAssemblyProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624833(145-153)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624833
Al-Zoube M(2022)Efficient vision-based multi-target augmented reality in the browserMultimedia Tools and Applications10.1007/s11042-022-12206-681:10(14303-14320)Online publication date: 25-Feb-2022
https://doi.org/10.1007/s11042-022-12206-6
Nitika NSharma TRajvanshi SKishore K(2021)A study of Augmented Reality performance in web browsers (WebAR)2021 2nd International Conference on Computational Methods in Science & Technology (ICCMST)10.1109/ICCMST54943.2021.00065(281-286)Online publication date: Dec-2021
https://doi.org/10.1109/ICCMST54943.2021.00065
Show More Cited By

Index Terms

Efficient pose tracking from natural features in standard web browsers
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Online 6 DOF Augmented Reality Registration from Natural Features
ISMAR '02: Proceedings of the 1st International Symposium on Mixed and Augmented Reality

We present a complete scalable system for 6 d.o.f. camera tracking based on natural features. Crucially, the calculation is based only on pre-captured reference images and previous estimates of the camera pose and is hence suitable for online ...
Augmented visualization with natural feature tracking
MUM '11: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia

Visualization systems often require large monitors or projection screens to display complex information. Even very sophisticated systems that exhibit complex user interfaces do usually not exploit advanced input and output devices. One of the reasons ...
Real-time camera pose estimation via line tracking

Real-time camera calibration has been intensively studied in augmented reality. However, for texture-less and texture-repeated scenes as well as poorly illuminated scenes, obtaining a stable calibration is still an open problem. In the paper, we propose ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

Web3D '18: Proceedings of the 23rd International ACM Conference on 3D Web Technology

June 2018

199 pages

ISBN:9781450358002

DOI:10.1145/3208806

General Chairs:
Krzysztof Walczak
Poznań University of Economics and Business, Poland
,
Gabriel Zachmann
University of Bremen, Germany
,
Program Chairs:
Jakub Flotyński
Poznań University of Economics and Business, Poland
,
Kiyoshi Kiyokawa
Nara Institute of Science and Technology, Japan
,
Daniel Thalmann
MIRALab Sarl, Switzerland, and EPFL

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

Web3D '18

Sponsor:

SIGGRAPH

Web3D '18: The 23rd International Conference on 3D Web Technology

June 20 - 22, 2018

Poznań, Poland

Acceptance Rates

Overall Acceptance Rate 27 of 71 submissions, 38%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
175
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu KWu NHan BMontpetit MLeivadeas AUhlig SJaved M(2023)Demystifying Web-based Mobile Extended Reality Accelerated by WebAssemblyProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624833(145-153)Online publication date: 24-Oct-2023
https://dl.acm.org/doi/10.1145/3618257.3624833
Al-Zoube M(2022)Efficient vision-based multi-target augmented reality in the browserMultimedia Tools and Applications10.1007/s11042-022-12206-681:10(14303-14320)Online publication date: 25-Feb-2022
https://doi.org/10.1007/s11042-022-12206-6
Nitika NSharma TRajvanshi SKishore K(2021)A study of Augmented Reality performance in web browsers (WebAR)2021 2nd International Conference on Computational Methods in Science & Technology (ICCMST)10.1109/ICCMST54943.2021.00065(281-286)Online publication date: Dec-2021
https://doi.org/10.1109/ICCMST54943.2021.00065
Lehmann DPradel MBahar IHerlihy MWitchel ELebeck A(2019)WasabiProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304068(1045-1058)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304068

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents