More Web Proxy on the site http://driver.im/

research-article

Muse: a multimedia streaming enabled remote interactivity system for mobile devices

Authors:

Liang ZhongAuthors Info & Claims

MUM '11: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia

Pages 216 - 225

https://doi.org/10.1145/2107596.2107624

Published: 07 December 2011 Publication History

Abstract

Recent years we have witnessed the rapid advent of mobile cloud computing, in which remote software is delivered as a service and accessed by mobile device users over the Internet. However, most existing remote display technologies for high motion application (e.g, movie) have defects in latency and bandwidth. In this paper, we designed an adaptive multimedia streaming enabled remote interactivity system, Muse, to utilize remote resources with reduced display update traffic and response latency. A window-aware updating mechanism is designed as an adaptation scheme, which allows users to focus on the current application in use and also enable them to switch between applications on the fly. Besides, a windowed display encoder using H.264 video codec is integrated into the remote frame buffer protocol to achieve high performance in compression to address the high latency limitation of mobile Internet. Experimental results show that the windowed display Muse mechanism can successfully reduce network traffic, loading time and response latency of remote display and interaction. Our system can achieve in average 22fps of 1024*768 desktop multimedia playbacks with good video quality under 1 Mbit/s of bandwidth limitation.

References

[1]

Jianxin Li, Yu Jia, Lu Liu, Tianyu Wo. CyberLiveApp: A secure sharing and migration approach for live virtual desktop applications in a cloud environment. Future Generation Computer Systems. August 2011.

[2]

RFB Protocol. http://www.realvnc.com/docs/rfbproto.pdf

[3]

R. A. Baratto, L. Kim, J. Nieh, THINC: A Virtual Display Architecture for Thin-Client Computing, Proceedings of 20th ACM Symposium on Operating System Principles(SOSP 2005), Brighton, UK, October 23--26, 2005. Pp. 277--290.

Digital Library

[4]

RDP, http://en.wikipedia.org/wiki/Remote_Desktop_Protocol

[5]

CITRIX, http://www.citrix.com

[6]

Joeng Kim, Ricardo A. Baratto, and Jason Nieh, pTHINC: A Thin-Client Architecure for Mobile Wireless Web. Proceedings of the 15th International World Wide Web Conference(WWW 2006), May 23--26. Edinburgh, Scotland. 2006, 143--152.

Digital Library

[7]

Huifeng Shen, Yan Lu, Feng Wu, Shipeng Li, "A High-Performance Remote Computing Platform", Proceedings of the 2009 IEEE International Conference on Pervasive Computing and Communications.

Digital Library

[8]

L. Deboosere, J. De Wachter, P. Simoens, F. De Turck, B. Dhoedt, and P. Demeester, "Thin Client Computing Solutions in Low- and High-Motion Scenarios," Proc. IEEE Third International Conference on Networking and Service, pp. 38--43, June. 2007.

Digital Library

[9]

P. Simoens, P. Praet, B. Vankeirbilck, and J. De Wachter, "Design and Implementation of a Hybrid remote display protocol to optimize multimedia experience on thin client devices," Proc. IEEE Telecommunication Networks and Applications Conference, pp. 22--25, Dec. 2008.

[10]

Kheng-Joo Tan, Jia-Wei Gong, Bing-Tsung Wu, Dou-Cheng Chang, Hsin-Yi Li, Yi-Mao Hsiao, Yung-Chung Chen, Shi-Wu Lo, Yuan-Sun Chu, Jiun-In Guo, A remote thin client system for real time multimedia streaming over VNC, ICME 2010, pp. 992--9967, 2010 IEEE International Conference on Multimedia and Expo, 2010.

[11]

B. Vankeirsbilck, P. Simoens, J. De Wachter, L. Deboosere, F. De Turck, B. Dhoedt, P. Demeester, "Bandwidth Optimization for Mobile Thin Client Computing through Graphical Update Caching", ATNAC 2008.

[12]

M. Mitrea, P. Simoens, B. Joveski, J. Marshall, A. Taguengayte, F. Preteux, B. Dhoedt, "BiFS-based approaches to remote display for mobile thin clients," in Proceedings of the SPIE - The International Society for Optical Engineering, vol. 7444, 2009 2009, p. 74440F (8pp.).

[13]

A. Boukerche, R. W. N. Pazzi, and J. Feng, "An end-to-end virtual environment streaming technique for thin mobile devices over heterogeneous networks," COMPUTER COMMUNICATIONS, vol. 31, no. 11, pp. 2716--2725, JUL 15 2008.

Digital Library

[14]

R. W. N. Pazzi, A. Boukerche, and T. Huang, "Implementation, measurement, and analysis of an image-based virtual environment streaming protocol for wireless mobile devices," IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, vol. 57, no. 9, pp. 1894--1907, SEP 2008.

[15]

P. Simoens, B. Vankeirsbilck, L. Deboosere, F. A. Ali, F. De Turck, B. Dhoedt, and P. Demeester, "Upstream bandwidth optimization of thin client protocols through latency-aware adaptive user event buffering," Int. J. Commun. Syst., Accepted for publication {available online}, 2010.

Digital Library

[16]

Mahadev Satyanarayanan, Paramvir Bahl, Ramon Caceres, Nigel Davies. The case for VM-based Cloudlets in Mobile Computing, IEEE Pervasive Computing, November 2009.

Digital Library

[17]

Akamai -- http://www.akamai.cn

[18]

S. Wang, S. Dey, "Modeling and Characterizing User Experience in a Cloud Server Based Mobile Gaming Approach", GLOBECOM 2009.

Digital Library

[19]

S. J. Yang, J. Nieh, M. Selsky, N. Tiwari, "The Performance of Remote Display Mechanisms for Thin-Client Computing", Proceedings of the 2002 USENIX Annual Technical Conference, June 2002.

Digital Library

[20]

Niraj Tolia, David G. Andersen, and M. Satyanarayanan, "Quantifying Interactive User Experience on Thin Clients", COMPUTER 2006.

Digital Library

[21]

Y. Chang, P. Tseng, K. Chen, C. Lei, "Understanding The Performance of Thin-Client Gaming", CQR Workshop 2011.

[22]

Y. Endo, Z. Wang, J. Chen, M. Seltzer, "Using Latency to Evaluate Interactive System Performance", OSDI 1996.

Digital Library

[23]

S. Wang, S. Dey, "Rendering Adaptation to Address Communication and Computation Constraints in Cloud Mobile Gaming", GLOBECOM 2010.

[24]

S. Wang, S. Dey, "Addressing Response Time and Video Quality in Remote Server Based Internet Mobile Gaming", WCNC, 2010.

[25]

MetaVNC, http://metavnc.sourceforge.net/

[26]

T264, http://sourceforge.net/projects/t264/

[27]

Android VNC Viewer, http://code.google.com/p/android-vnc-viewer/

[28]

TightVNC, http://www.tightvnc.com/

[29]

THINC Project, http://systems.cs.columbia.edu/projects/thinc/

Cited By

Dong HKinfe AYu JLiu QKilper DWilliams RVeeraraghavan M(2023)Towards Enabling Residential Virtual-Desktop ComputingIEEE Transactions on Cloud Computing10.1109/TCC.2021.311390511:1(745-762)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3113905
Yang SLi BSong YXu JLu Y(2019)A Hardware-Accelerated System for High Resolution Real-Time Screen SharingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.280969029:3(881-891)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1109/TCSVT.2018.2809690
Alali FAdams TFoley RKilper DWilliams RVeeraraghavan M(2019)Methods for Objective and Subjective Evaluation of Zero-Client ComputingIEEE Access10.1109/ACCESS.2019.29250837(94569-94582)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2925083
Show More Cited By

Index Terms

Muse: a multimedia streaming enabled remote interactivity system for mobile devices
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

pTHINC: a thin-client architecture for mobile wireless web
WWW '06: Proceedings of the 15th international conference on World Wide Web

Although web applications are gaining popularity on mobile wireless PDAs, web browsers on these systems can be quite slow and often lack adequate functionality to access many web sites. We have developed pTHINC, a PDA thin-client solution that leverages ...
An original-stream based solution for smoothly replaying high-definition videos in desktop virtualization systems

Existing desktop virtualization systems suffer from a very limited performance in replaying high-definition videos remotely: intolerable CPU and bandwidth consumption, high response delay and poor video quality. In this paper, we propose an original-...
THINC: a virtual display architecture for thin-client computing
SOSP '05

Rapid improvements in network bandwidth, cost, and ubiquity combined with the security hazards and high total cost of ownership of personal computers have created a growing market for thin-client computing. We introduce THINC, a virtual display ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '11: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia

December 2011

242 pages

ISBN:9781450310963

DOI:10.1145/2107596

General Chairs:
Qionghai Dai
Tsinghua University, China
,
Ramesh Jain
University of California, Irvine
,
Program Chairs:
Xiangyang Ji
Tsinghua University, China
,
Matthias Kranz
Technische Universität München, Germany

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Tsinghua University: Tsinghua University

In-Cooperation

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 December 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

MUM'11

Sponsor:

Tsinghua University

MUM'11: The International Conference on Mobile and Ubiquitous Multimedia

December 7 - 9, 2011

Beijing, China

Acceptance Rates

MUM '11 Paper Acceptance Rate 29 of 66 submissions, 44%;

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
387
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dong HKinfe AYu JLiu QKilper DWilliams RVeeraraghavan M(2023)Towards Enabling Residential Virtual-Desktop ComputingIEEE Transactions on Cloud Computing10.1109/TCC.2021.311390511:1(745-762)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3113905
Yang SLi BSong YXu JLu Y(2019)A Hardware-Accelerated System for High Resolution Real-Time Screen SharingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.280969029:3(881-891)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1109/TCSVT.2018.2809690
Alali FAdams TFoley RKilper DWilliams RVeeraraghavan M(2019)Methods for Objective and Subjective Evaluation of Zero-Client ComputingIEEE Access10.1109/ACCESS.2019.29250837(94569-94582)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2925083
Song TWang JWu JMa RLiang AGu TQi Z(2018)FastDeskFuture Generation Computer Systems10.1016/j.future.2017.07.00181:C(478-491)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1016/j.future.2017.07.001
Zhang YQu PCihang JZheng W(2016)A Cloud Gaming System Based on User-Level Virtualization and Its Resource SchedulingIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.243391627:5(1239-1252)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2433916
Layek MChung THuh E(2016)Adaptive Desktop Delivery Scheme for Provisioning Quality of Experience in Cloud Desktop as a ServiceThe Computer Journal10.1093/comjnl/bxv11659:2(260-274)Online publication date: 6-Jan-2016
https://doi.org/10.1093/comjnl/bxv116
Xu YMao S(2015)Mobile Cloud MediaGamification10.4018/978-1-4666-8200-9.ch107(2126-2147)Online publication date: 31-Mar-2015
https://doi.org/10.4018/978-1-4666-8200-9.ch107
Xu YMao S(2014)Mobile Cloud MediaMobile Networks and Cloud Computing Convergence for Progressive Services and Applications10.4018/978-1-4666-4781-7.ch002(18-38)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-4781-7.ch002
Godoy ATeixeira CKulesza RTavares T(2014)An Architecture to Promote the Use of Mobile Devices on Interactions with Media Synthesized RemotelyProceedings of the 20th Brazilian Symposium on Multimedia and the Web10.1145/2664551.2664563(143-150)Online publication date: 18-Nov-2014
https://dl.acm.org/doi/10.1145/2664551.2664563
Yang MFu JLu YCai JFoh C(2014)An adaptive multi-layer low-latency transmission scheme for H.264 based screen sharing system2014 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS.2014.6865594(2153-2156)Online publication date: Jun-2014
https://doi.org/10.1109/ISCAS.2014.6865594
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents