[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

HTTP/2-based Frame Discarding for Low-Latency Adaptive Video Streaming

Published: 07 February 2019 Publication History

Abstract

In this article, we propose video delivery schemes insuring around 1s delivery latency with Dynamic Adaptive Streaming over HTTP (DASH), which is a standard version of HTTP Live Streaming (HLS), so as to benefit from the video representation switching between successive video segments. We also propose HTTP/2-based algorithms to apply video frame discarding policies inside a video segment when a selected DASH representation does not match with the available network resources. The current solutions with small buffer suffer from rebuffering events. Rebuffering not only impacts the Quality of Experience (QoE) but also increases the delivery delay between the displayed and the original video streams. In this work, we completely eliminate rebuffering events by developing optimal and practical video frame discarding algorithms to meet the 1s latency constraint. In all our algorithms, we request the video frames individually through HTTP/2 multiple streams, and we selectively drop the least meaningful video frames thanks to HTTP/2 stream resetting feature. Our simulations show that the proposed algorithms eliminate rebuffering while insuring an acceptable video quality with at least a Peak Signal to Noise Ratio (PSNR) of 35dB compared to 25dB of the basic First In First Out (FIFO) algorithm. We also quantify and qualify the resulting temporal distortion of the video segments per algorithm. An important number of missing video frames results in a temporal fluidity break known as video jitter. The displayed video looks like a series of snapshots. We show that both the optimal Integer Linear Program (ILP) and practical algorithms decrease the frequency and duration of the jitters. For example, practical algorithms reduce the number of crashed displayed videos (presenting one jitter longer than 1,350ms) with 22% compared to the basic FIFO algorithm. We also show that requesting video frames separately with HTTP/2 slightly increases the overhead from 4.34% to 5.76%.

References

[1]
Mike Belshe, Roberto Peon, and Martin Thomson. 2015. Hypertext Transfer Protocol Version 2 (HTTP/2) Standard. RFC 7540. IETF.
[2]
Mariem Ben-Yahia, Yannick Le Louédec, Loutfi Nuaymi, and Gwendal Simon. 2017. When HTTP/2 rescues DASH: Video frame multiplexing. In Proceedings of the IEEE Conference on Computer Communications Workshops Workshops (INFOCOM’17). 677--682.
[3]
Nassima Bouzakaria, Cyril Concolato, and Jean Le Feuvre. 2014. Overhead and performance of low latency live streaming using MPEG-DASH. In Proceedings of the International Conference on Information, Intelligence, Systems and Applications (IISA’14). 92--97.
[4]
Nassima Bouzakaria, Cyril Concolato, and Jean Le Feuvre. 2015. Fast DASH bootstrap. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP’15).
[5]
Pete Campbell. 2016. Why Every Brand Needs to Migrate to HTTP/2 and How To Do It. Technical Report. State of Digital.
[6]
Jacob Chakareski, John G. Apostolopoulos, Wai-tian Tan, Susie Wee, and Bernd Girod. 2004. Distortion chains for predicting the video distortion for general packet loss patterns. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’04). 1001--1004.
[7]
Yueh-Lun Chang, Ting-Lan Lin, and Pamela C. Cosman. 2012. Network-based H.264/AVC whole-frame loss visibility model and frame dropping methods. IEEE Trans. Image Process. 21, 8 (2012), 3353--3363.
[8]
Wael Chérif, Youenn Fablet, Eric Nassor, Jonathan Taquet, and Yuki Fujimori. 2015. DASH fast start using HTTP/2. In Proceedings of the ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV’15). 25--30.
[9]
Cisco. 2017. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016--2021 White Paper.
[10]
Conv. 2015. Viewer Experience Report 2015. Conviva Annual Report.
[11]
Xavier Corbillon, Ramon Aparicio-Pardo, Nicolas Kuhn, Géraldine Texier, and Gwendal Simon. 2016a. Cross-layer scheduler for video streaming over MPTCP. In Proceedings of the International Conference on Multimedia Systems (MMSys’16). 7:1--7:12.
[12]
Xavier Corbillon, Florian Boyrivent, Gregoire Asselin De Williencourt, Gwendal Simon, Géraldine Texier, and Jacob Chakareski. 2016b. Efficient lightweight video packet filtering for large-scale video data delivery. In Proceedings of the IEEE International Conference on Multimedia 8 Expo Workshops (ICME’16). 1--6.
[13]
Khalid A. Darabkh, Abeer M. Awad, and Ala F. Khalifeh. 2014. Efficient PFD-based networking and buffering models for improving video quality over congested links. Wireless Pers. Commun. 79, 1 (2014), 293--320.
[14]
Khalid A. Darabkh, Abeer M. Awad, and Ala F. Khalifeh. 2015. New video discarding policies for improving UDP performance over wired/wireless networks. Int. J. Netw. Manage. 25, 3 (2015), 181--202.
[15]
Florin Dobrian, Asad Awan, Dilip Antony Joseph, Aditya Ganjam, Jibin Zhan, Vyas Sekar, Ion Stoica, and Hui Zhang. 2013. Understanding the impact of video quality on user engagement. Commun. ACM 56, 3 (2013), 91--99.
[16]
Zhengfang Duanmu, Kai Zeng, Kede Ma, Abdul Rehman, and Zhou Wang. 2017. A quality-of-experience index for streaming video. J. Sel. Top. Sign. Process. 11, 1 (2017), 154--166.
[17]
Jean Le Feuvre, Cyril Concolato, Nassima Bouzakaria, and Viet-Thanh-Trung Nguyen. 2015. MPEG-DASH for low latency and hybrid streaming services. In Proceedings of the Annual ACM Conference on Multimedia Conference (MM’15). 751--752.
[18]
Deepak Gangadharan, Linh T. X. Phan, Samarjit Chakraborty, Roger Zimmermann, and Insup Lee. 2011. Video quality driven buffer sizing via frame drops. In Proceedings of the IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA’11), Volume 1. 319--328.
[19]
Patrice Houze, Emmanuel Mory, Géraldine Texier, and Gwendal Simon. 2016. Applicative-layer multipath for low-latency adaptive live streaming. In Proceedings of the IEEE International Conference on Communications (ICC’16). 1--7.
[20]
Quan Huynh-thu and Mohammed Ghanbari. 2006. Impact of jitter and jerkiness on perceived video quality. In Proceedings of the Second International Workshop on Video Processing and Quality Metrics for Consumer Electronics, (VPQM’06).
[21]
Rafael Huysegems, Tom Bostoen, Patrice Rondao-Alface, Jeroen van der Hooft, Stefano Petrangeli, Tim Wauters, and Filip De Turck. 2015. HTTP/2-based methods to improve the live experience of adaptive streaming. In Proceedings of the Annual ACM Conference on Multimedia Conference (MM’15).
[22]
ISO. 2012a. Coding of Audio-visual Objects—Part 10: Advanced Video Coding. Technical Report 14496-10. ISO/IEC.
[23]
ISO. 2012b. Dynamic Adaptive Streaming Over HTTP (DASH). Technical Report 23009. ISO/IEC.
[24]
ISO. 2015. Information Technology--High Efficiency Coding and Media Delivery in Heterogeneous Environments--Part 2: High Efficiency Video Coding. Technical Report 23008-2. ISO/IEC.
[25]
Athina Kalampogia and Polychronis Koutsakis. 2018. H.264 and H.265 video bandwidth prediction. IEEE Trans. Multimedia 20, 1 (2018), 171--182.
[26]
Theodoros Karagkioules, Cyril Concolato, Dimitrios Tsilimantos, and Stefan Valentin. 2017. A comparative case study of HTTP adaptive streaming algorithms in mobile networks. In Proceedings of the Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV’17). 1--6.
[27]
S. Shunmuga Krishnan and Ramesh K. Sitaraman. 2013. Video stream quality impacts viewer behavior: Inferring causality using quasi-experimental designs. IEEE/ACM Trans. Netw. 21, 6 (2013), 2001--2014.
[28]
Jonathan Kua, Grenville Armitage, and Philip Branch. 2017. A survey of rate adaptation techniques for dynamic adaptive streaming over HTTP. IEEE Commun. Surv. Tutor. 19, 3 (2017), 1842--1866.
[29]
Ke Liu and Jack Y. B. Lee. 2015. Achieving high throughput and low delay in mobile data networks by accurately predicting queue lengths. In Proceedings of the ACM International Conference on Computing Frontiers (CF’15). 20:1--20:8.
[30]
Linh Van Ma, Jaehyung Park, Jiseung Nam, HoYong Ryu, and Jinsul Kim. 2017. A fuzzy-based adaptive streaming algorithm for reducing entropy rate of DASH bitrate fluctuation to improve mobile quality of service. Entropy 19, 9 (2017), 477.
[31]
Saied Mehdian and Ben Liang. 2014. Jointly optimal selection and scheduling for lossy transmission of dependent frames with delay constraint. In Proceedings of the IEEE International Symposium of Quality of Service (IWQoS’14). 168--177.
[32]
Ricky K. P. Mok, Xiapu Luo, Edmond W. W. Chan, and Rocky K. C. Chang. 2012. QDASH: A QoE-aware DASH system. In Proceedings of the Annual ACM SIGMM Conference on Multimedia Systems (MMSys’12). 11--22.
[33]
Christopher Müller, Stefan Lederer, Christian Timmerer, and Hermann Hellwagner. 2013. Dynamic adaptive streaming over HTTP/2.0. In Proceedings of the IEEE International Conference on Multimedia and Expo (ICME’13). 1--6.
[34]
Ricardo Pastrana-Vidal and Jean-Charles Gicquel. 2006. Automatic quality assessment of video fluidity impairment using a no-reference metric. In Proceedings of Workshop Video Process. Quality Metrics for Consumer Electron (VPQM’06).
[35]
Alassane Samba, Yann Busnel, Alberto Blanc, Philippe Dooze, and Gwendal Simon. 2017. Instantaneous throughput prediction in cellular networks: Which information is needed? In Proceedings of the IFIP/IEEE Symposium on Integrated Network and Service Management (IM’17). 624--627.
[36]
Michael Seufert, Sebastian Egger, Martin Slanina, Thomas Zinner, Tobias Hoßfeld, and Phuoc Tran-Gia. 2015. A survey on quality of experience of HTTP adaptive streaming. IEEE Commun. Surv. Tutor. 17, 1 (2015), 469--492.
[37]
Kevin Spiteri, Ramesh Sitaraman, and Daniel Sparacio. 2018. From theory to practice: Improving bitrate adaptation in the DASH reference player. In Proceedings of the ACM Multimedia Systems Conference (MMSys’18).
[38]
Viswanathan Swaminathan and Sheng Wei. 2011. Low latency live video streaming using HTTP chunked encoding. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP’11). 1--6.
[39]
Truong Cong Thang, Quang-Dung Ho, Jung Won Kang, and Anh T. Pham. 2012. Adaptive streaming of audiovisual content using MPEG DASH. IEEE Trans. Consum. Electron. 58, 1 (2012), 78--85.
[40]
Christian Timmerer and Alan Bertoni. 2016. Advanced transport options for the dynamic adaptive streaming over HTTP. CoRR abs/1606.00264 (2016).
[41]
S. van Kester, T. Xiao, Robert E. Kooij, Kjell Brunnström, and O. K. Ahmed. 2011. Estimating the impact of single and multiple freezes on video quality. In Proceedings of the Human Vision and Electronic Imaging XVI, part of the IS&T-SPIE Electronic Imaging Symposium. 78650O.
[42]
Sheng Wei, Viswanathan Swaminathan, and Mengbai Xiao. 2015a. Power efficient mobile video streaming using HTTP/2 server push. In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP’15). 1--6.
[43]
Sheng Wei, Viswanathan Swaminathan, and Mengbai Xiao. 2015b. Power efficient mobile video streaming using HTTP/2 server push. In Proceedings of the ACM International Workshop on Multimedia Signal Processing (MMSP’15).
[44]
Nicolas Weil. 2016. The State of MPEG-DASH 2016. Technical Report 23009. Streaming Media.
[45]
Thomas Wiegand, Gary J. Sullivan, Gisle Bjøntegaard, and Ajay Luthra. 2003. Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7 (2003), 560--576.
[46]
Mengbai Xiao, Viswanathan Swaminathan, Sheng Wei, and Songqing Chen. 2016. Evaluating and improving push based video streaming with HTTP/2. In Proceedings of the International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV’16). 3:1--3:6.
[47]
Xiph.org. 1994-2016. Xiph.org Test Media. Retrieved from https://media.xiph.org/video/derf/.

Cited By

View all
  • (2024)Lumos: Optimizing Live 360-degree Video Upstreaming via Spatial-Temporal Integrated Neural EnhancementProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681305(7210-7219)Online publication date: 28-Oct-2024
  • (2024)A UAV-Centric Improved Soft Actor-Critic Algorithm for QoE-Focused Aerial Video StreamingIEEE Transactions on Vehicular Technology10.1109/TVT.2024.339634973:9(13498-13512)Online publication date: Sep-2024
  • (2024)PRETT2: Discovering HTTP/2 DoS Vulnerabilities via Protocol Reverse EngineeringComputer Security – ESORICS 202410.1007/978-3-031-70890-9_1(3-23)Online publication date: 6-Sep-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 15, Issue 1
February 2019
265 pages
ISSN:1551-6857
EISSN:1551-6865
DOI:10.1145/3309717
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 February 2019
Accepted: 01 September 2018
Revised: 01 May 2018
Received: 01 December 2017
Published in TOMM Volume 15, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. DASH
  2. HTTP/2
  3. Video delivery
  4. low latency
  5. video frame discarding
  6. wireless networks

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)34
  • Downloads (Last 6 weeks)2
Reflects downloads up to 21 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Lumos: Optimizing Live 360-degree Video Upstreaming via Spatial-Temporal Integrated Neural EnhancementProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681305(7210-7219)Online publication date: 28-Oct-2024
  • (2024)A UAV-Centric Improved Soft Actor-Critic Algorithm for QoE-Focused Aerial Video StreamingIEEE Transactions on Vehicular Technology10.1109/TVT.2024.339634973:9(13498-13512)Online publication date: Sep-2024
  • (2024)PRETT2: Discovering HTTP/2 DoS Vulnerabilities via Protocol Reverse EngineeringComputer Security – ESORICS 202410.1007/978-3-031-70890-9_1(3-23)Online publication date: 6-Sep-2024
  • (2023)PacketGame: Multi-Stream Packet Gating for Concurrent Video Inference at ScaleProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604825(724-737)Online publication date: 10-Sep-2023
  • (2023)Reparo: QoE-Aware Live Video Streaming in Low-Rate Networks by Intelligent Frame RecoveryProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3613441(9194-9204)Online publication date: 26-Oct-2023
  • (2023)Resolution Identification of Encrypted Video Streaming Based on HTTP/2 FeaturesACM Transactions on Multimedia Computing, Communications, and Applications10.1145/355189119:2(1-23)Online publication date: 6-Feb-2023
  • (2023)Fleet: Improving Quality of Experience for Low-Latency Live Video StreamingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.324390133:9(5242-5256)Online publication date: Sep-2023
  • (2023)Performance analysis of H2BR: HTTP/2-based segment upgrading to improve the QoE in HASMultimedia Tools and Applications10.1007/s11042-023-15516-583:5(12561-12595)Online publication date: 11-Jul-2023
  • (2023)Low Latency Low Loss Media Delivery Utilizing In-Network Packet WashJournal of Network and Systems Management10.1007/s10922-022-09712-131:1Online publication date: 23-Jan-2023
  • (2022)Online Learning for Adaptive Video Streaming in Mobile NetworksACM Transactions on Multimedia Computing, Communications, and Applications10.1145/346081918:1(1-22)Online publication date: 27-Jan-2022
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media