[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Link-Aware Reconfigurable Point-to-Point Video Streaming for Mobile Devices

Published: 24 August 2015 Publication History

Abstract

Even though people of all social standings use current mobile devices in the wide spectrum of purpose from entertainment tools to communication means, some issues with real-time video streaming in hostile wireless environment still exist. In this article, we introduce CoSA, a link-aware real-time video streaming system for mobile devices. The proposed system utilizes a 3D camera to distinguish the region of importance (ROI) and non-ROI region within the video frame. Based on the link-state feedback from the receiver, the proposed system allocates a higher bandwidth for the region that is classified as ROI and a lower bandwidth for non-ROI in the video stream by reducing the video's bit rate. We implemented CoSA in a real test-bed where the IEEE 802.11 is employed as a medium for wireless networking. Furthermore, we verified the effectiveness of the proposed system by conducting a thorough empirical study. The results indicate that the proposed system enables real-time video streaming while maintaining a consistent visual quality by dynamically reconfiguring video coding parameters according to the link quality.

References

[1]
Nasir Ahmed, T. Natarajan, and Kamisetty R. Rao. 1974. Discrete cosine transform. IEEE Trans. Comput. 100, 1, 90--93.
[2]
Saamer Akhshabi, Ali C. Begen, and Constantine Dovrolis. 2011. An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 157--168.
[3]
Istemi Ekin Akkus, Oznur Ozkasap, and M. Reha Civanlar. 2011. Peer-to-peer multipoint video conferencing with layered video. J. Network Comput. Appl. 34, 1, 137--150.
[4]
Paolo Bellavista, Marcello Cinque, Domenico Cotroneo, and Luca Foschini. 2009. Self-adaptive handoff management for mobile streaming continuity. IEEE Trans. Network Serv. Manage. 6, 2, 80--94.
[5]
Paolo Bellavista, Antonio Corradi, and Carlo Giannelli. 2011. Differentiated management strategies for multi-hop multipath heterogeneous connectivity in mobile environments. IEEE Trans. Network Serv. Manage. 8, 3, 190--204.
[6]
E. J. Delp and O. R. Mitchell. 1979. Image compression using block truncation coding. IEEE Trans. Commun. 27, 9, 1335--1342.
[7]
EBU. 2010. High Definition (HD) Image formats for television production. Tech. Rep., EBU-TECH 3299. EBU, Geneva.
[8]
Mohammad H. Hajiesmaili, Ahmad Khonsari, Ali Sehati, and Mohammad Sadegh Talebi. 2012. Content-aware rate allocation for efficient video streaming via dynamic network utility maximization. J. Network Comput. Appl. 35, 6, 2016--2027.
[9]
M. A. Haleem and Rajarathnam Chandramouli. 2005. Adaptive downlink scheduling and rate selection: A cross-layer design. IEEE J. Sel. Areas Commun. 23, 6, 1287--1297.
[10]
Cheng-Hsin Hsu and Mohamed Hefeeda. 2011. A Framework for Cross-layer Optimization of Video Streaming in Wireless Networks. ACM Trans. Multimedia Comput. Commun. Appl. 7, 1, Article 5.
[11]
Chih-Lin Hu and Chien-An Cho. 2011. User-provided multimedia content distribution architecture in mobile and ubiquitous communication networks. J. Network Comput. Appl. 34, 1, 121--136.
[12]
Q. Huynh-Thu and M. Ghanbari. 2008. Scope of validity of PSNR in image/video quality assessment. Electron. Lett. 44, 13, 800--801.
[13]
ITU-T Recommendation J.247. 2008. Objective perceptual multimedia video quality measurement in the presence of a full-reference. http://www.itu.int/rec/T-REC-J.247-200808-I/en.
[14]
Szymon Jakubczak, Hariharan Rahul, and Dina Katabi. 2009. One-size-fits-all wireless video. In Proceedings of the 8th ACM SIGCOMM HotNets Workshop.
[15]
Wen Ji, Min Chen, Xiaohu Ge, Peng Li, and Yiqiang Chen. 2011. A perceptual macroblock layer power control for energy scalable video encoder based on just noticeable distortion principle. J. Network Comput. Appl. 34, 5, 1489--1497.
[16]
Hari Kalva, Velibor Adzic, and Borko Furht. 2012. Comparing MPEG AVC and SVC for adaptive HTTP streaming. In Proceedings of the IEEE International Conference on Consumer Electronics. IEEE, 158--159.
[17]
Hwangnam Kim, Jennifer C. Hou, Chunyu Hu, and Ye Ge. 2007. QoS provisioning in IEEE 802.11-compliant networks: Past, present, and future. Comput. Networks 51, 8, 1922--1941.
[18]
Hyun Soon Kim, Eugene Kim, and Hwangnam Kim. 2012. QoE-driven Wi-Fi selection mechanism for next generation smartphones. In Proceedings of the 1st IEEE Workshop on Enabling Technologies for Smartphone and Internet of Things. IEEE, 13--18.
[19]
M. Kouadio and U. Pooch. 2002. Technology on social issues of videoconferencing on the Internet: A survey. J. Network Comput. Appl. 25, 1, 37--56.
[20]
Didier Le Gall. 1991. MPEG: A video compression standard for multimedia applications. Commun. ACM 34, 4, 46--58.
[21]
Suk Kyu Lee, Jihoon Ryoo, Seungho Yoo, Jongtack Jung, Woonghee Lee, and Hwangnam Kim. 2013. CoSA: Adaptive link-aware real-time streaming for mobile devices. In Proceedings of the IEEE 9th International Conference on Wireless and Mobile Computing, Networking and Communications. IEEE, 681--686.
[22]
Yan Li, Athina Markopoulou, John Apostolopoulos, and Nicholas Bambos. 2008. Content-aware playout and packet scheduling for video streaming over wireless links. IEEE Trans. Multimedia 10, 5, 885--895.
[23]
Günther Liebl, Mark Kalman, and Bernd Girod. 2005. Deadline-aware scheduling for wireless video streaming. In Proceedings of the. IEEE International Conference on Multimedia and Expo. IEEE, 4--pp.
[24]
Bangalore S. Manjunath, Philippe Salembier, and Thomas Sikora. 2002. Introduction to MPEG-7: Multimedia Content Description Interface. Vol. 1, John Wiley & Sons.
[25]
D. Marpe, H. Schwarz, and T. Wiegand. 2003. Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard. IEEE Trans. Circuits Syst. Video Technol. 13, 7 (2003), 620--636.
[26]
Anush K. Moorthy, Kalpana Seshadrinathan, Rajiv Soundararajan, and Alan Conrad Bovik. 2010. Wireless video quality assessment: A study of subjective scores and objective algorithms. IEEE Trans. Circuits Syst. Video Technol. 20, 4, 587--599.
[27]
MPEG. 2014. The moving picture experts group. http://mpeg.chiariglione.org/.
[28]
Pengpeng Ni, Ragnhild Eg, Alexander Eichhorn, Carsten Griwodz, and Pål Halvorsen. 2011. Flicker effects in adaptive video streaming to handheld devices. In Proceedings of the 19th ACM International Conference on Multimedia. ACM, 463--472.
[29]
Vít Novotnỳ and Dan Komosnỳ. 2008. Large-scale RTCP feedback optimization. J. Networks 3, 3, 1--10.
[30]
OpenNI. 2011. OpenNI SDK. (2011). http://www.openni.org/openni-sdk/.
[31]
Tanır Ozçelebi, M. Oguz Sunay, A. Murat Tekalp, and M. Reha Civanlar. 2007. Cross-layer optimized rate adaptation and scheduling for multiple-user wireless video streaming. IEEE J. Sel. Areas Commun. 25, 4, 760--769.
[32]
Paul Patras, Albert Banchs, and Pablo Serrano. 2012. A control theoretic scheme for efficient video transmission over IEEE 802.11e EDCA WLANs. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, Article 29.
[33]
Massimo Piccardi. 2004. Background subtraction techniques: A review. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. Vol. 4, IEEE, 3099--3104.
[34]
Margaret H. Pinson and StephenWolf. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcast. 50, 3, 312--322.
[35]
Iain E. Richardson. 2004. H. 264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia. Wiley.com.
[36]
Haakon Riiser, Tore Endestad, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2012. Video streaming using a location-based bandwidth-lookup service for bitrate planning. ACM Trans. Multimedia Comput. Commun. Appl. 8, 3, 24.
[37]
Haakon Riiser, Paul Vigmostad, Carsten Griwodz, and Pål Halvorsen. 2011. Bitrate and video quality planning for mobile streaming scenarios using a GPS-based bandwidth lookup service. In Proceedings of the IEEE International Conference on Multimedia and Expo. IEEE, 1--6.
[38]
Jonathan Rosenberg and Henning Schulzrinne. 1998. Timer reconsideration for enhanced RTP scalability. In Proceedings of the 17th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'98). Vol. 1. IEEE, 233--241.
[39]
Jonathan Rosenberg, Henning Schulzrinne, Gonzalo Camarillo, et al. 2002. SIP: Session initiation protocol. Tech. Rep., RFC 3261, Internet Engineering Task Force.
[40]
R. Sudhakar, R. Karthiga, and S. Jayaraman. 2005. Image compression using coding of wavelet coefficients: A survey. ICGST Int. J. Graphics Vision Image Process. 5, 6, 25--38.
[41]
Heiko Schwarz, Detlev Marpe, and Thomas Wiegand. 2007. Overview of the scalable video coding extension of the H.264/AVC standard. IEEE Trans. Circuits Syst. Video Technol. 17, 9, 1103--1120.
[42]
Eric Setton, Taesang Yoo, Xiaoqing Zhu, Andrea Goldsmith, and Bernd Girod. 2005. Cross-layer design of ad-hoc networks for real-time video streaming. IEEE Wirel. Commun. 12, 4, 59--65.
[43]
Thomas Stockhammer. 2011. Dynamic adaptive streaming over HTTP--: standards and design principles. In Proceedings of the 2nd Annual ACM Conference on Multimedia Systems. ACM, 133--144.
[44]
Wai-Tian Tan and Avideh Zakhor. 1999. Real-time Internet video using error resilient scalable compression and TCP-friendly transport protocol. IEEE Trans. Multimedia 1, 2, 172--186.
[45]
Samira Tavakoli, Kjell Brunnström, Kun Wang, Börje Andrén, Muhammad Shahid, and Narciso Garcia. 2014. Subjective quality assessment of an adaptive video streaming model. Proc. SPIE, vol. 9016, International Society for Optics and Photonics, 90160K--90160K.
[46]
Gary A. Thom. 1996. H. 323: the multimedia communications standard for local area networks. IEEE Commun. Mag. 34, 12, 52--56.
[47]
Yubing Wang. 2006. Survey of objective video quality measurements. Tech. Rep., EMC Corporation.
[48]
Andrew B. Watson. 1994. Image compression using the discrete cosine transform. Mathematica J. 4, 81--88.
[49]
Shinuk Woo and Hwangnam Kim. 2013. An empirical interference modeling for link reliability assessment in wireless networks. IEEE/ACM Trans Networking 21.
[50]
Weiwen Zhang, Yonggang Wen, Zhenzhong Chen, and Ashish Khisti. 2013. QoE-driven cache management for HTTP adaptive bit rate streaming over wireless networks. IEEE Trans. Multimedia 15, 6, 1431--1445.
[51]
Li Zhao, Qi Wang, Yuwen He, Shiqiang Yang, and Yuzhuo Zhong. 2001. A novel content-based video streaming algorithm for fine granular scalable coding. In Management of Multimedia on the Internet, Ehab S. Al-Shaer and Giovanni Pacifici (Eds.). Lecture Notes in Computer Science, vol. 2216, Springer, 210--214.
[52]
Liang Zhou, XinbingWang, Wei Tu, G. Muntean, and Benoit Geller. 2010. Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks. IEEE J. Sel. Areas Commun. 28, 3, 409--419.

Cited By

View all
  • (2024)A Multi-Stage Approach to UAV Detection, Identification, and Tracking Using Region-of-Interest Management and Rate-Adaptive Video CodingApplied Sciences10.3390/app1413555914:13(5559)Online publication date: 26-Jun-2024
  • (2023)AQuA-CEP: Adaptive Quality-Aware Complex Event Processing in the Internet of ThingsProceedings of the 17th ACM International Conference on Distributed and Event-based Systems10.1145/3583678.3596884(13-24)Online publication date: 27-Jun-2023
  • (2022)Towards adaptive quality-aware Complex Event Processing in the Internet of Things2022 18th International Conference on Mobility, Sensing and Networking (MSN)10.1109/MSN57253.2022.00095(571-575)Online publication date: Dec-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Multimedia Computing, Communications, and Applications
ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 12, Issue 1
August 2015
220 pages
ISSN:1551-6857
EISSN:1551-6865
DOI:10.1145/2816987
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015
Accepted: 01 April 2015
Revised: 01 August 2014
Received: 01 April 2014
Published in TOMM Volume 12, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Link-state feedback
  2. mobile multimedia system
  3. reconfigurable video coding

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)A Multi-Stage Approach to UAV Detection, Identification, and Tracking Using Region-of-Interest Management and Rate-Adaptive Video CodingApplied Sciences10.3390/app1413555914:13(5559)Online publication date: 26-Jun-2024
  • (2023)AQuA-CEP: Adaptive Quality-Aware Complex Event Processing in the Internet of ThingsProceedings of the 17th ACM International Conference on Distributed and Event-based Systems10.1145/3583678.3596884(13-24)Online publication date: 27-Jun-2023
  • (2022)Towards adaptive quality-aware Complex Event Processing in the Internet of Things2022 18th International Conference on Mobility, Sensing and Networking (MSN)10.1109/MSN57253.2022.00095(571-575)Online publication date: Dec-2022
  • (2019)Enactment of Adaptation in Data Stream Processing with Latency Implications—A Systematic Literature ReviewInformation and Software Technology10.1016/j.infsof.2019.03.006Online publication date: Mar-2019
  • (2018)Integrated approach of streaming 3d multimedia contents in real-time for mobile devicesMultimedia Tools and Applications10.1007/s11042-016-4339-577:2(1811-1842)Online publication date: 1-Jan-2018
  • (2016)Real-Time Load Reduction in Multimedia Big Data for Mobile InternetACM Transactions on Multimedia Computing, Communications, and Applications10.1145/299047312:5s(1-20)Online publication date: 12-Oct-2016

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media