More Web Proxy on the site http://driver.im/

research-article

Towards Fully Offloaded Cloud-based AR: Design, Implementation and Experience

Authors:

Jiangchuan LiuAuthors Info & Claims

MMSys'17: Proceedings of the 8th ACM on Multimedia Systems Conference

Pages 321 - 330

https://doi.org/10.1145/3083187.3084012

Published: 20 June 2017 Publication History

Abstract

Combining advanced sensors and powerful processing capabilities smart-phone based augmented reality (AR) is becoming increasingly prolific. The increase in prominence of these resource hungry AR applications poses significant challenges to energy constrained environments such as mobile-phones.; AB@To that end we present a platform for offloading AR applications to powerful cloud servers. We implement this system using a thin-client design and explore its performance using the real world application Pokemon Go as a case study. We show that with careful design a thin client is capable of offloading much of the AR processing to a cloud server, with the results being streamed back. Our initial experiments show substantial energy savings, low latency and excellent image quality even at relatively low bit-rates.

References

[1]

Wei Cai, Ryan Shea, Chun-Ying Huang, Kuan-Ta Chen, Jiangchuan Liu, Victor CM Leung, and Cheng-Hsin Hsu. 2016. The Future of Cloud Gaming {Point of View}. Proc. IEEE 104, 4 (2016), 687--691.

[2]

Hal Hodson. 2012. Google's Ingress game is a gold mine for augmented reality. New Scientist 216, 2893 (2012), 19.

[3]

Wenlu Hu, Ying Gao, Kiryong Ha, Junjue Wang, Brandon Amos, Zhuo Chen, Padmanabhan Pillai, and Mahadev Satyanarayanan. 2016. Quantifying the impact of edge computing on mobile applications. In Proceedings of the 7th ACM SIGOPS Asia-Pacific Workshop on Systems. ACM, 5.

Digital Library

[4]

Chun-Ying Huang, Cheng-Hsin Hsu, Yu-Chun Chang, and Kuan-Ta Chen. 2013. Gaming Anywhere: an open cloud gaming system. In Proceedings of the 4th ACM multimedia systems conference. ACM, 36--47.

Digital Library

[5]

Zhanpeng Huang, Weikai Li, Pan Hui, and Christoph Peylo. 2014. CloudRidAR: A cloud-based architecture for mobile augmented reality. In Proceedings of the 2014 workshop on Mobile augmented reality and robotic technology-based systems. ACM, 29--34.

Digital Library

[6]

Puneet Jain, Justin Manweiler, and Romit Roy Choudhury. 2015. Overlay: Practical mobile augmented reality. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 331--344.

Digital Library

[7]

Puneet Jain, Justin Manweiler, and Romit Roy Choudhury. 2016. Low Bandwidth Offload for Mobile AR. In Proceedings of the 12th International on Conference on emerging Networking Experiments and Technologies. ACM, 237--251.

Digital Library

[8]

Li Lin et al. 2014. Liverender: A cloud gaming system based on compressed graphics streaming. In Proceedings of the 22nd ACM international conference on Multimedia. ACM, 347--356.

Digital Library

[9]

Fangming Liu, Peng Shu, Hai Jin, Linjie Ding, Jie Yu, Di Niu, and Bo Li. 2013. Gearing resource-poor mobile devices with powerful clouds: architectures, challenges, and applications. IEEE Wireless communications 20, 3 (2013), 14--22.

[10]

Nayyab Zia Naqvi, Karel Moens, Arun Ramakrishnan, Davy Preuveneers, Danny Hughes, and Yolande Berbers. 2015. To cloud or not to cloud: a context-aware deployment perspective of augmented reality mobile applications. In Proceedings of the 30th Annual ACM Symposium on Applied Computing. ACM, 555--562.

Digital Library

[11]

B. Richerzhagen, D. Stingl, R. Hans, C. Gross, and R. Steinmetz. 2014. Bypassing the cloud: Peer-assisted event dissemination for augmented reality games. In Proc. IEEE International Conference on Peer-to-Peer Computing (P2P). 1--10.

[12]

Mahadev Satyanarayanan. 2015. A brief history of cloud offload: A personal journey from odyssey through cyber foraging to cloudlets. GetMobile: Mobile Computing and Communications 18, 4 (2015), 19--23.

Digital Library

[13]

Ryan Shea, Jiangchuan Liu, Edith C-H Ngai, and Yong Cui. 2013. Cloud gaming: architecture and performance. IEEE Network 27, 4 (2013), 16--21.

[14]

Bowen Shi, Ji Yang, Zhanpeng Huang, and Pan Hui. 2015. Offloading Guidelines for Augmented Reality Applications on Wearable Devices. In Proceedings of the 23rd ACM international conference on Multimedia. ACM, 1271--1274.

Digital Library

[15]

Luke Stone. 2016. Bringing Pokemon GO to life on Google cloud. https://cloudplatform.googleblog.com/2016/09/bringing-Pokemon-GO-to-life-on-Google-Cloud.html. (29 09 2016).

Cited By

Alimamy SJung T(2024)The AR Cloud: Navigating Metaverse Augmentation Technologies for Enhanced Co-Creation of Value Within ServicesJournal of Service Research10.1177/10946705241265753Online publication date: 24-Jul-2024
https://doi.org/10.1177/10946705241265753
Ding ADe Alwis CLiyanage M(2024)ReferencesMobile Edge Computing and Communications10.1002/9781119611646.refs(209-243)Online publication date: 27-Dec-2024
https://doi.org/10.1002/9781119611646.refs
Hammad NEiszler TGazda RCartmell JHarpstead EHammer J(2023)V-Light: Leveraging Edge Computing For The Design of Mobile Augmented Reality GamesProceedings of the 18th International Conference on the Foundations of Digital Games10.1145/3582437.3582456(1-10)Online publication date: 12-Apr-2023
https://dl.acm.org/doi/10.1145/3582437.3582456
Show More Cited By

Recommendations

On the Networking Challenges of Mobile Augmented Reality
VR/AR Network '17: Proceedings of the Workshop on Virtual Reality and Augmented Reality Network

In this paper, we conduct a reality check for Augmented Reality (AR) on mobile devices. We dissect and measure the cloud-offloading feature for computation-intensive visual tasks of two popular commercial AR systems. Our key finding is that their cloud-...
CARS: Collaborative Augmented Reality for Socialization
HotMobile '18: Proceedings of the 19th International Workshop on Mobile Computing Systems & Applications

As Augmented Reality (AR) ties closely to the physical world, its users looking at overlapped scenes are likely to be in the vicinity of each other, which naturally enables the collaboration and interaction among them. In this paper, we propose CARS (...
Exhibition approach using an AR and VR pillar
SA '17: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications

This demonstration presents a development of an Augmented Reality (AR) and Virtual Reality (AR) pillar, a novel approach for showing AR and VR content in a public setting. A pillar in a public exhibition venue was converted to a four-sided AR and VR ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys'17: Proceedings of the 8th ACM on Multimedia Systems Conference

June 2017

407 pages

ISBN:9781450350020

DOI:10.1145/3083187

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MMSys'17

Sponsor:

SIGMM

MMSys'17: Multimedia Systems Conference 2017

June 20 - 23, 2017

Taipei, Taiwan

Acceptance Rates

MMSys'17 Paper Acceptance Rate 13 of 47 submissions, 28%;

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
492
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)6

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alimamy SJung T(2024)The AR Cloud: Navigating Metaverse Augmentation Technologies for Enhanced Co-Creation of Value Within ServicesJournal of Service Research10.1177/10946705241265753Online publication date: 24-Jul-2024
https://doi.org/10.1177/10946705241265753
Ding ADe Alwis CLiyanage M(2024)ReferencesMobile Edge Computing and Communications10.1002/9781119611646.refs(209-243)Online publication date: 27-Dec-2024
https://doi.org/10.1002/9781119611646.refs
Hammad NEiszler TGazda RCartmell JHarpstead EHammer J(2023)V-Light: Leveraging Edge Computing For The Design of Mobile Augmented Reality GamesProceedings of the 18th International Conference on the Foundations of Digital Games10.1145/3582437.3582456(1-10)Online publication date: 12-Apr-2023
https://dl.acm.org/doi/10.1145/3582437.3582456
Park GKim RSong H(2023)Collaborative Virtual 3D Object Modeling for Mobile Augmented Reality Streaming Services Over 5G NetworksIEEE Transactions on Mobile Computing10.1109/TMC.2022.314954322:7(3855-3869)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TMC.2022.3149543
Lan TZhao J(2023)Optimization in Mobile Augmented Reality Systems for the Metaverse Over Wireless CommunicationsGLOBECOM 2023 - 2023 IEEE Global Communications Conference10.1109/GLOBECOM54140.2023.10437658(5439-5444)Online publication date: 4-Dec-2023
https://doi.org/10.1109/GLOBECOM54140.2023.10437658
Rohit TAthrij SGopalan S(2023)Protocol for Dynamic Load Distributed Low Latency Web-Based Augmented Reality and Virtual RealityComputational Intelligence in Communications and Business Analytics10.1007/978-3-031-48879-5_10(118-129)Online publication date: 30-Nov-2023
https://doi.org/10.1007/978-3-031-48879-5_10
Huang ZFriderikos VDohler MAghvami H(2021)Granular VNF-Based MicroservicesDesign Innovation and Network Architecture for the Future Internet10.4018/978-1-7998-7646-5.ch009(250-271)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-7646-5.ch009
Athrij SSanthosh AJayashankar RPadmanabhan AJyothis (2021)Dynamic Load Distribution in web-based AR2021 5th International Conference on Artificial Intelligence and Virtual Reality (AIVR)10.1145/3480433.3480440(21-28)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3480433.3480440
Estrela VAndreopoulos NSroufer RJesus MMamani WPeixoto A(2021)Transmedia Ecosystems, Quality of Experience and Quality of Service in Fog Computing for Comfortable Learning2021 IEEE Global Engineering Education Conference (EDUCON)10.1109/EDUCON46332.2021.9454002(1003-1009)Online publication date: 21-Apr-2021
https://doi.org/10.1109/EDUCON46332.2021.9454002
Siriwardhana YPorambage PLiyanage MYlianttila M(2021)A Survey on Mobile Augmented Reality With 5G Mobile Edge Computing: Architectures, Applications, and Technical AspectsIEEE Communications Surveys & Tutorials10.1109/COMST.2021.306198123:2(1160-1192)Online publication date: Oct-2022
https://doi.org/10.1109/COMST.2021.3061981
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents