Compass: A Prefetching Framework with Viewport Patching for 360° Video Streaming
Authors: 
Wenjing Su, Yueheng Li, Hao Chen, Zhan MaAuthors Info & Claims
Pages 45 - 51
Abstract
Viewport-dependent streaming strategies are widely adopted in 360° video streaming for bandwidth-saving benefits. These strategies extend a marginal area around the predicted viewport to compensate for inevitable viewport prediction errors. However, existing approaches rely on predefined distribution patterns to extend the marginal area symmetrically, resulting in not only reduced video quality within the viewport but also substantial bandwidth wastage. In this paper, we propose Compass, a prefetching framework with viewport patching for 360° video streaming. Compass simultaneously determines the direction and size of the marginal area based on historical user head movement (HM) velocity and prediction error. Additionally, we introduce a competition-based viewport prediction algorithm and a progressive prefetching mechanism to accurately prefetch video streams before users view them. Simulations conducted using publicly available real user HM trajectories demonstrate the superiority of Compass in improving video quality and saving bandwidth compared to existing schemes.
References
[1]
360VidStr. 2021. https://github.com/360VidStr/A-large-dataset-of-360-video-user-behaviour.
[2]
bytedance. 2023. https://bytedance.larkoffice.com/drive/folder/SbedfxFYBlRHhjdskuicnzosnyd.
[3]
Xavier Corbillon, Francesca De Simone, and Gwendal Simon. 2017. 360-Degree Video Head Movement Dataset (MMSys'17). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3083187.3083215
[4]
Yago Sánchez de la Fuente, Gurdeep Singh Bhullar, Robert Skupin, Cornelius Hellge, and Thomas Schierl. 2019. Delay Impact on MPEG OMAF's Tile-Based Viewport-Dependent 360° Video Streaming. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2019), 18--28. https://doi.org/10.1109/JETCAS.2019.2899516
[5]
Junaid Fukuta, Nina Gill, Rebecca Rooney, Alan Coombs, and David Murphy. 2021. Use of 360° Video for a Virtual Operating Theatre Orientation for Medical Students. Journal of Surgical Education 78, 2 (2021), 391--393. https://doi.org/10.1016/j.jsurg.2020.08.014
[6]
Ehab Ghabashneh, Chandan Bothra, Ramesh Govindan, Antonio Ortega, and Sanjay Rao. 2023. Dragonfly: Higher perceptual quality for continuous 360 video playback. In Proceedings of the ACM SIGCOMM 2023 Conference. 516--532.
[7]
Yu Guan, Chengyuan Zheng, Xinggong Zhang, Zongming Guo, and Junchen Jiang. 2019. Pano: optimizing 360° video streaming with a better understanding of quality perception. In Proceedings of the ACM Special Interest Group on Data Communication (Beijing, China) (SIGCOMM '19). Association for Computing Machinery, New York, NY, USA, 394--407. https://doi.org/10.1145/3341302.3342063
[8]
Yongqiang Gui, Yanyan Suo, Tian Zhang, Zhenhua Yu, and Shu Shi. 2023. Poster: E3PO - An Open Platform for 360° Video Streaming Simulation and Evaluation. In Proceedings of the 2023 ACM on Internet Measurement Conference (Montreal QC, Canada) (IMC '23). Association for Computing Machinery, New York, NY, USA, 716--717. https://doi.org/10.1145/3618257.3624995
[9]
Zhiqian Jiang, Xu Zhang, Yiling Xu, Zhan Ma, Jun Sun, and Yunfei Zhang. 2021. Reinforcement Learning Based Rate Adaptation for 360-Degree Video Streaming. IEEE Transactions on Broadcasting 67, 2 (2021), 409--423. https://doi.org/10.1109/TBC.2020.3028286
[10]
Nuowen Kan, Junni Zou, Chenglin Li, Wenrui Dai, and Hongkai Xiong. 2022. RAPT360: Reinforcement Learning-Based Rate Adaptation for 360-Degree Video Streaming With Adaptive Prediction and Tiling. IEEE Transactions on Circuits and Systems for Video Technology 32, 3 (2022), 1607--1623. https://doi.org/10.1109/TCSVT.2021.3076585
[11]
Li Li, Zhu Li, Madhukar Budagavi, and Houqiang Li. 2017. Projection based advanced motion model for cubic mapping for 360-degree video. In 2017 IEEE International Conference on Image Processing (ICIP). 1427--1431. https://doi.org/10.1109/ICIP.2017.8296517
[12]
Wen-Chih Lo, Ching-Ling Fan, Jean Lee, Chun-Ying Huang, Kuan-Ta Chen, and Cheng-Hsin Hsu. 2017. 360° Video Viewing Dataset in Head-Mounted Virtual Reality. In Proceedings of the 8th ACM on Multimedia Systems Conference (Taipei, Taiwan) (MMSys'17). Association for Computing Machinery, New York, NY, USA, 211--216. https://doi.org/10.1145/3083187.3083219
[13]
Afshin Taghavi Nasrabadi, Aliehsan Samiei, Anahita Mahzari, Ryan P. McMahan, Ravi Prakash, Mylène C. Q. Farias, and Marcelo M. Carvalho. 2019. A taxonomy and dataset for 360° videos. In Proceedings of the 10th ACM Multimedia Systems Conference (Amherst, Massachusetts) (MMSys '19). Association for Computing Machinery, New York, NY, USA, 273--278. https://doi.org/10.1145/3304109.3325812
[14]
Sohee Park, Arani Bhattacharya, Zhibo Yang, Samir R. Das, and Dimitris Samaras. 2021. Mosaic: Advancing User Quality of Experience in 360-Degree Video Streaming With Machine Learning. IEEE Transactions on Network and Service Management 18, 1 (2021), 1000--1015. https://doi.org/10.1109/TNSM.2021.3053183
[15]
Feng Qian, Bo Han, Qingyang Xiao, and Vijay Gopalakrishnan. 2018. Flare: Practical Viewport-Adaptive 360-Degree Video Streaming for Mobile Devices. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (New Delhi, India) (MobiCom '18). Association for Computing Machinery, New York, NY, USA, 99--114. https://doi.org/10.1145/3241539.3241565
[16]
Feng Qian, Lusheng Ji, Bo Han, and Vijay Gopalakrishnan. 2016. Optimizing 360 video delivery over cellular networks. In Proceedings of the 5th Workshop on All Things Cellular: Operations, Applications and Challenges (New York City, New York) (ATC '16). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/2980055.2980056
[17]
Sima Rahimizhian, Ali Ozturen, and Mustafa Ilkan. 2020. Emerging realm of 360-degree technology to promote tourism destination. Technology in Society 63 (2020), 101411. https://doi.org/10.1016/j.techsoc.2020.101411
[18]
risa2000. 2023. HMD Geometry Database. https://risa2000.github.io/hmdgdb/.
[19]
David Salomon. 2006. Transformations and Projections in Computer Graphics. https://link.springer.com/book/10.1007/978-1-84628-620-9.
[20]
Liyang Sun, Fanyi Duanmu, Yong Liu, Yao Wang, Yinghua Ye, Hang Shi, and David Dai. 2019. A Two-Tier System for On-Demand Streaming of 360 Degree Video Over Dynamic Networks. IEEE Journal on Emerging and Selected Topics in Circuits and Systems 9, 1 (2019), 43--57. https://doi.org/10.1109/JETCAS.2019.2898877
[21]
En Sing Wong, Nur Haliza Abdul Wahab, Faisal Saeed, and Nouf Alharbi. 2022. 360-Degree Video Bandwidth Reduction: Technique and Approaches Comprehensive Review. Applied Sciences 12, 15 (2022). https://doi.org/10.3390/app12157581
[22]
Chenglei Wu, Zhihao Tan, Zhi Wang, and Shiqiang Yang. 2017. A Dataset for Exploring User Behaviors in VR Spherical Video Streaming. In Proceedings of the 8th ACM on Multimedia Systems Conference (Taipei, Taiwan) (MMSys'17). Association for Computing Machinery, New York, NY, USA, 193--198. https://doi.org/10.1145/3083187.3083210
[23]
Daniel Wuebben, Jose Luis Rubio-Tamayo, Manuel Gertrudix Barrio, and Juan Romero-Luis. 2023. 360° Video for Research Communication and Dissemination: A Case Study and Guidelines. IEEE Transactions on Professional Communication 66, 1 (2023), 59--77. https://doi.org/10.1109/TPC.2022.3228022
[24]
Jiang Yu and Yong Liu. 2019. Field-of-view prediction in 360-degree videos with attention-based neural encoder-decoder networks (MMVE '19). Association for Computing Machinery, New York, NY, USA, 37--42. https://doi.org/10.1145/3304113.3326118
[25]
Hui Yuan, Shiyun Zhao, Junhui Hou, Xuekai Wei, and Sam Kwong. 2020. Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos. IEEE Journal of Selected Topics in Signal Processing 14, 1 (2020), 177--193. https://doi.org/10.1109/JSTSP.2019.2957981
Index Terms
- Compass: A Prefetching Framework with Viewport Patching for 360° Video Streaming
Recommendations
PARIMA: Viewport Adaptive 360-Degree Video Streaming
WWW '21: Proceedings of the Web Conference 2021With increasing advancements in technologies for capturing 360° videos, advances in streaming such videos have become a popular research topic. However, streaming 360° videos require high bandwidth, thus escalating the need for developing optimized ...
Viewport prediction for 360° videos: a clustering approach
NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and VideoAn important component for viewport-adaptive streaming of 360° videos is viewport prediction. Increasing viewport prediction horizon enables the client to prefetch more chunks into the playback buffer. Having longer buffer results in less rebuffering ...
LiveAE: Attention-based and Edge-assisted Viewport Prediction for Live 360° Video Streaming
EMS '23: Proceedings of the 2023 Workshop on Emerging Multimedia SystemsViewport prediction plays a crucial role in live 360° video streaming as it determines which tiles should be prefetched in high quality, thereby significantly impacting the user experience. However, the current approach to viewport prediction, which ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
August 2024
63 pages
ISBN:9798400707117
DOI:10.1145/3672196
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 August 2024
Accepted: 09 June 2024
Revised: 09 June 2024
Received: 19 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ACM SIGCOMM '24
Sponsor:
Acceptance Rates
EMS '24 Paper Acceptance Rate 9 of 15 submissions, 60%;
Overall Acceptance Rate 9 of 15 submissions, 60%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 97Total Downloads
- Downloads (Last 12 months)97
- Downloads (Last 6 weeks)11
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in