[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3123266.3123291acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming

Published: 19 October 2017 Publication History

Abstract

Recently, there has been a significant interest towards 360-degree panorama video. However, such videos usually require extremely high bitrate which hinders their widely spread over the Internet. Tile-based viewport adaptive streaming is a promising way to deliver 360-degree video due to its on-request portion downloading. But it is not trivial for it to achieve good Quality of Experience (QoE) because Internet request-reply delay is usually much higher than motion-to-photon latency. In this paper, we leverage a probabilistic approach to pre-fetch tiles countering viewport prediction error, and design a QoE-driven viewport adaptation system, 360ProbDASH. It treats user's head movement as probability events, and constructs a probabilistic model to depict the distribution of viewport prediction error. A QoE-driven optimization framework is proposed to minimize total expected distortion of pre-fetched tiles. Besides, to smooth border effects of mixed-rate tiles, the spatial quality variance is also minimized. With the requirement of short-term viewport prediction under a small buffer, it applies a target-buffer-based rate adaptation algorithm to ensure continuous playback. We implement 360ProbDASH prototype and carry out extensive experiments on a simulation test-bed and real-world Internet with real user's head movement traces. The experimental results demonstrate that 360ProbDASH achieves at almost 39% gains on viewport PSNR, and 46% reduction on spatial quality variance against the existed viewport adaptation methods.

References

[1]
ISO/IEC 23009--1:2014/Amd 2:2015 Spatial Relationship Description, Generalized URL Parameters and Other Extensions.
[2]
S. Akhshabi, A. C. Begen, and C. Dovrolis. 2011. An Experimental Evaluation of Rate-adaptation Algorithms in Adaptive Streaming over HTTP Proceedings of the second annual ACM Conference on Multimedia Systems (MMSys). ACM, 157--168.
[3]
Gene Cheung, Zhi Liu, Zhiyou Ma, and Jack ZG Tan. 2017. Multi-Stream Switching for Interactive Virtual Reality Video Streaming arXiv preprint arXiv:1703.09090.
[4]
Lucia D'Acunto, Jorrit van den Berg, Emmanuel Thomas, and Omar Niamut. 2016. Using MPEG DASH SRD for Zoomable and Navigable Video Proceedings of the 7th International Conference on Multimedia Systems (MMSys). ACM, 34.
[5]
Vamsidhar Reddy Gaddam, Michael Riegler, Ragnhild Eg, Carsten Griwodz, and Pål Halvorsen. 2016. Tiling in Interactive Panoramic Video: Approaches and Evaluation. IEEE Transactions on Multimedia (TMM) Vol. 18, 9 (2016), 1819--1831.
[6]
Mohammad Hosseini. 2017. View-aware Tile-based Adaptations in 360 Virtual Reality Video Streaming IEEE Virtual Reality (VR). IEEE, 423--424.
[7]
Mohammad Hosseini and Viswanathan Swaminathan. 2016. Adaptive 360 VR Video Streaming: Divide and Conquer 2016 IEEE International Symposium on Multimedia (ISM). IEEE, 107--110.
[8]
Masayuki Inoue, Hideaki Kimata, Katsuhiko Fukazawa, and Norihiko Matsuura. 2010. Interactive Panoramic Video Streaming System over Restricted Bandwidth Network Proceedings of the ACM International Conference on Multimedia (MM). ACM, 1191--1194.
[9]
ISO/IEC JTC1/SC29/WG11/M. 2016. VR/360 Video Truncated Square Pyramid Geometry for OMAF.
[10]
Mina Makar, Aditya Mavlankar, Piyush Agrawal, and Bernd Girod. 2010. Real-time Video Streaming with Interactive Region-of-interest IEEE International Conference on Image Processing (ICIP). IEEE, 4437--4440.
[11]
King-To Ng, Shing-Chow Chan, and Heung-Yeung Shum. 2005. Data Compression and Transmission Aspects of Panoramic Videos. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), Vol. 15, 1 (2005), 82--95.
[12]
Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 Video Delivery over Cellular Networks Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges. ACM, 1--6.
[13]
Ngo Quang Minh Khiem, Guntur Ravindra, Axel Carlier, and Wei Tsang Ooi. 2010. Supporting Zoomable Video Streams with Dynamic Region-of-interest Cropping Proceedings of the first annual ACM Conference on Multimedia Systems (MMSys). ACM, 259--270.
[14]
Robert Skupin, Yago Sanchez, Cornelius Hellge, and Thomas Schierl. 2016. Tile Based HEVC Video for Head Mounted Displays. 2016 IEEE International Symposium on Multimedia (ISM). IEEE, 399--400.
[15]
J. P. Snyder. 1993. Flattening the Earth: Two Thousand Years of Map Projections. University of Chicago Press (1993).
[16]
Kashyap Kammachi Sreedhar, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications. In 2016 IEEE International Symposium on Multimedia (ISM). IEEE, 583--586.
[17]
ISO/IEC JTC1/SC29/WG11 W13533. 2012. MPEG DASH: The Standard for Multimedia Streaming over the Internet.
[18]
Hui Wang, Vu-Thanh Nguyen, Wei Tsang Ooi, and Mun Choon Chan. 2014. Mixing Tile Resolutions in Tiled Video: A perceptual Quality Assessment Proceedings of Network and Operating System Support on Digital Audio and Video Workshop (NOSSDAV). ACM, 25.
[19]
Richard Yao, Tom Heath, Aaron Davies, Tom Forsyth, Nate Mitchell, and Perry Hoberman. 2014. Oculus VR Best Practices Guide. Oculus VR (2014).
[20]
Matt Yu, Haricharan Lakshman, and Bernd Girod. 2015. A Framework to Evaluate Omnidirectional Video Coding Schemes IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 31--36.
[21]
Alireza Zare, Alireza Aminlou, Miska M Hannuksela, and Moncef Gabbouj. 2016. HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications Proceedings of the ACM International Conference on Multimedia (MM). ACM, 601--605.

Cited By

View all
  • (2025)A review on machine learning based user-centric multimedia streaming techniquesComputer Communications10.1016/j.comcom.2024.108011231(108011)Online publication date: Feb-2025
  • (2024)Scene Graph Driven Hybrid Interactive VR TeleconferencingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3684996(11276-11278)Online publication date: 28-Oct-2024
  • (2024)STAR-VP: Improving Long-term Viewport Prediction in 360° Videos via Space-aligned and Time-varying FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681268(5556-5565)Online publication date: 28-Oct-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '17: Proceedings of the 25th ACM international conference on Multimedia
October 2017
2028 pages
ISBN:9781450349062
DOI:10.1145/3123266
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 360-degree video
  2. dash
  3. qoe-driven optimization
  4. rate and viewport adaptation
  5. tile-based adaptive streaming

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • Culture Development Funding

Conference

MM '17
Sponsor:
MM '17: ACM Multimedia Conference
October 23 - 27, 2017
California, Mountain View, USA

Acceptance Rates

MM '17 Paper Acceptance Rate 189 of 684 submissions, 28%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)120
  • Downloads (Last 6 weeks)10
Reflects downloads up to 19 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2025)A review on machine learning based user-centric multimedia streaming techniquesComputer Communications10.1016/j.comcom.2024.108011231(108011)Online publication date: Feb-2025
  • (2024)Scene Graph Driven Hybrid Interactive VR TeleconferencingProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3684996(11276-11278)Online publication date: 28-Oct-2024
  • (2024)STAR-VP: Improving Long-term Viewport Prediction in 360° Videos via Space-aligned and Time-varying FusionProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681268(5556-5565)Online publication date: 28-Oct-2024
  • (2024)LCR360: Efficient Head Movement Prediction and Viewport Sharing in 360° Video StreamingProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3696210(2084-2090)Online publication date: 4-Dec-2024
  • (2024)OMMSProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3653435(429-434)Online publication date: 15-Apr-2024
  • (2024)Just-in-Time Transcoding of 360° Video StreamsProceedings of the 15th ACM Multimedia Systems Conference10.1145/3625468.3647614(89-99)Online publication date: 15-Apr-2024
  • (2024)Motion-Prediction-Based Wireless Scheduling for Interactive Panoramic Scene DeliveryIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.332542011:2(1566-1579)Online publication date: Mar-2024
  • (2024)Non-Orthogonal Multiple Access Enhanced Scalable 360-Degree Video MulticastIEEE Transactions on Multimedia10.1109/TMM.2024.337990726(8488-8503)Online publication date: 2024
  • (2024)CoLive: Edge-Assisted Clustered Learning Framework for Viewport Prediction in 360$^{\circ }$ Live StreamingIEEE Transactions on Multimedia10.1109/TMM.2023.333011226(5078-5091)Online publication date: 1-Jan-2024
  • (2024)DACOD360: Deadline-Aware Content Delivery for 360-Degree Video Streaming Over MEC NetworksIEEE Transactions on Multimedia10.1109/TMM.2023.332143926(4168-4182)Online publication date: 1-Jan-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media