Abstract
Screen transmission is an essential part of Desktop as a Service (DaaS) which directly influence the quality of experience (QoE). In this paper, we propose a novel QoE improvement scheme that dynamically controls the quality setting of the image compression before the screen transmission to decrease response time of the system still maintaining the satisfactory image quality, hence improves the QoE in interactive applications in a band-limited environment. The proposed scheme first selects the best quality setting appropriate for current network bandwidth quota, then uses the remaining bandwidth to improve the quality setting of low motion regions without any adverse effect on response time. To enable the adaptive quality selection and image quality refinement, we propose a compressed image file size inference model and a block priority calculation method respectively. Particularly, we implement our QoE Improvement Scheme to work with screen content coding. Both quantitative measurements and users’ evaluations in the experiments show that our QoE improvement scheme improves QoS as well as QoE by utilizing the available network bandwidth efficiently.
Similar content being viewed by others
Notes
We compute network bandwidth quota for a frame buffer update based on the end-to-end network bandwidth and an expected response time.
In this paper, we choose JPEG as our target image encoder. However, the same procedure can be applied to other image compressions in constructing similar models.
References
Abu L Md, TaeChoong C, Eui-Nam H (2016) Adaptive desktop delivery scheme for provisioning quality of experience in cloud desktop as a service. Comput J 59(2):260–274. doi:10.1093/comjnl/bxv116. http://comjnl.oxfordjournals.org/content/59/2/260
An NT, Huynh Ct, Lee B, Hong CS (2014) An efficient block classification for media healthcare service in mobile cloud computing. Multimed Tools Appl 1–15.
Deboosere L, De Wachter J, Simoens P, De Turck F, Dhoedt B, Demeester P (2007) Thin client computing solutions in low- and high-motion scenarios. In: 3rd international conference on networking and services, ICNS 2007. doi:10.1109/ICNS.2007.115
Fei-Fei L, Fergus R, Perona P (2004) Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: Conference on computer vision and pattern recognition workshop (CVPR 2004), p 178. doi:10.1109/CVPR.2004.109
Fenner W C, McCanne S, Berc LM, Frederick R (1995) RTP payload format for JPEG-compressed video (internet draft IETF). Tech Rep. IETF 59(2):260–274. https://tools.ietf.org/html/rfc2035, accessed 10 October 2016
Huang A, Dijiang (2011) Mobile cloud computing. IEEE COMSOC Multimed Commun Tech Committee (MMTC) E-Lett 6(10):27–31
ITU-T Recommendations (2012) Methodology for the subjective assessment of the quality of television pictures. Int Telecommun Union 1–48. http://www.itu.int/rec/R-REC-BT.500/en
ITU-T Recommendation (2014) Requirements for desktop as a service, International Telecommunications Union, Geneva, Switzerland. https://www.itu.int/rec/T-REC-Y.3503-201405-I/en, accessed 10 October 2016
ITU-T Recommendation (2016) H.264: advanced video coding for generic audiovisual services, International Telecommunications Union, Geneva, Switzerland. https://www.itu.int/rec/T-REC-H.264, accessed 10 October 2016
Jing W, Xuetao G, Yang Z (2013) An adaptive encoding application sharing system based on remote display. In: Proceedings of the 2013 3rd international conference on intelligent system design and engineering applications, ISDEA 2013, pp 266–269. doi:10.1109/ISDEA.2012.66
Kaplinsky KV (2001a) Vnc tight encoder - comparison results. http://www.tightvnc.com/archive/compare.html, accessed 12 September 2016
Kaplinsky KV (2001b) VNC tight encoder-data compression for VNC. In: Proceedings of the 7th International scientific and practical conference of students, post-graduates and young scientists: modern techniques and technology, MTT 2001, pp 155–157
Layek A, Chung T, Huh E (2016) Efficient screen splitting methods - a case study in block-wise motion detection. KSII Trans Internet Inf Syst 10(10):5074—5094. doi:10.3837/tiis.2016.10.024
Lin T, Hao P (2005) Compound image compression for real-time computer screen image transmission. IEEE Trans Image Process 14 (8):993–1005. doi:10.1109/TIP.2005.849776
Melorose J, Perroy R, Careas S (2015) The remote framebuffer protocol. Statewide Agri Land Use Baseline 1:1–39. doi:10.1017/CBO9781107415324.004. arXiv:1011.1669v3
Microsoft (2016) Microsoft remote desktop protocol: basic connectivity and graphics remoting specification. https://msdn.microsoft.com/en-us/library/cc240445.aspx, accessed 13 March 2017
Simoens P, Praet P, Vankeirsbilck B, De Wachter J, Deboosere L, De Turck F, Dhoedt B, Demeester P (2008) Design and implementation of a hybrid remote display protocol to optimize multimedia experience on thin client devices. In: Proceedings of the 2008 Australasian telecommunication networks and applications conference, ATNAC 2008, pp 391–396. doi:10.1109/ATNAC.2008.4783356
Song B, Tang W, Nguyen TD, Hassan MM, Huh EN (2013) An optimized hybrid remote display protocol using GPU-assisted M-JPEG encoding and novel high-motion detection algorithm. J Supercomput 66(3):1729–1748. doi:10.1007/s11227-013-0972-1
Theora (2011) Theora Specification, video for everyone. http://theora.org/doc/Theora.pdf, accessed 10 October 2016
Tolia N, Andersen DG, Satyanarayanan M (2006) Quantifying interactive user experience on thin clients. Computer 39(3):46–52. doi:10.1109/MC.2006.101
Wallace GK (1992) The JPEG still picture compression standard. IEEE Trans Consum Electron 38(1):xviii–xxxiv. doi:10.1109/30.125072
Wikipedia (2016e) Peak signal-to-noise ratio. https://en.wikipedia.org/w/index.php?title=Peak_signal-to-noise_rati&oldid=731597489, accessed 12 September 2016
Zhang X J, Takahashi H (2007) A hybrid data compression scheme for improved VNC. Syst Cybern Inf 5(2):2–5
(2016a) libjpeg-turbo. http://www.libjpeg-turbo.org/, accessed 12 September 2016
(2016b) Turbovnc. http://www.turbovnc.org//, accessed 19 September 2016
(2016) Libvncserver. https://libvnc.github.io/, accessed 19 September 2016
(2016) FreeRDP. http://www.freerdp.com, accessed 14 March 2017
Acknowledgements
This research was supported by the MSIP(Ministry of Science, ICT and Future Planning), Korea, under the ITRC(Information Technology Research Center) support program (IITP-2017-2013-0-00717) supervised by the IITP(Institute for Information & communications Technology Promotion)). Professor Eui-Nam Huh is the corresponding author.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ngo, Q., Md. Abu, L., Pham, X. et al. A remote display QoE improvement scheme for interactive applications in low network bandwidth environment. Multimed Tools Appl 76, 22217–22241 (2017). https://doi.org/10.1007/s11042-017-4692-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4692-z