[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Rate-distortion optimized streaming of fine-grained scalable video sequences

Published: 11 February 2008 Publication History

Abstract

We present optimal schemes for allocating bits of fine-grained scalable video sequences among multiple senders streaming to a single receiver. This allocation problem is critical in optimizing the perceived quality in peer-to-peer and distributed multi-server streaming environments. Senders in such environments are heterogeneous in their outgoing bandwidth and they hold different portions of the video stream. We first formulate and optimally solve the problem for individual frames, then we generalize to the multiple frame case. Specifically, we formulate the allocation problem as an optimization problem, which is nonlinear in general. We use rate-distortion models in the formulation to achieve the minimum distortion in the rendered video, constrained by the outgoing bandwidth of senders, availability of video data at senders, and incoming bandwidth of receiver. We show how the adopted rate-distortion models transform the nonlinear problem to an integer linear programming (ILP) problem. We then design a simple rounding scheme that transforms the ILP problem to a linear programming (LP) one, which can be solved efficiently using common optimization techniques such as the Simplex method. We prove that our rounding scheme always produces a feasible solution, and the solution is within a negligible margin from the optimal solution. We also propose a new algorithm (FGSAssign) for the single-frame allocation problem that runs in O(nlog n) steps, where n is the number of senders. We prove that FGSAssign is optimal. Furthermore, we propose a heuristic algorithm (mFGSAssign) that produces near-optimal solutions for the multiple-frame case, and runs an order of magnitude faster than the optimal one. Because of its short running time, mFGSAssign can be used in real time. Our experimental study validates our analytical analysis and shows the effectiveness of our allocation algorithms in improving the video quality.

References

[1]
Begen, A., Altunbasak, Y., and Begen, M. 2003. Rate-distortion optimized on-demand media streaming with server diversity. In Proceedings of the IEEE International Conference on Image Processing (ICIP'03) (Barcelona, Spain). IEEE Computer Society Press, Los Alamitos, CA.
[2]
Chakareski, J. and Girod, B. 2003. Rate-distortion optimized packet scheduling and routing for media streaming with path diversity. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT).
[3]
Chou, P. and Miao, Z. 2006. Rate-distortion optimized streaming of packetized media. IEEE Trans. Multimed. 8, 2 (Apr.), 390--404.
[4]
Cormen, T., Leiserson, C., Rivest, R., and Stein, C. 2001. Introduction to Algorithms, 2nd ed. MIT Press, Cambridge, MA.
[5]
Cui, Y. and Nahrstedt, K. 2003. Layered peer-to-peer streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03) (Monterey, CA). ACM, New York.
[6]
Dai, M. and Loguinov, D. 2003. Analysis of rate-distortion functions and congestion control in scalable Internet video streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03). (Monterey, CA). ACM, New York.
[7]
Dai, M., Loguinov, D., and Radha, H. 2004. Rate-distortion modeling of scalable video coders. In Proceedings of the IEEE International Conference on Image Processing (ICIP'04) (Singapore). IEEE Computer Society Press, Los Alamitos, CA.
[8]
de Cuetos, P., Seeling, P., Reisslein, M., and Ross, K. 2005. Comparing the streaming of FGS encoded video at different aggregation levels: frame, GoP, and scene. Int. J. Commun. Syst. 18, 5 (June), 449--464.
[9]
Goldfarb, D. and Todd, M. 1989. Linear programming. Handbook Oper. Res. Manage. Sci. Optimiz. 1, 73--170.
[10]
Hefeeda, M., Habib, A., Xu, D., Bhargava, B., and Botev, B. 2005. CollectCast: A peer-to-peer service for media streaming. ACM/Springer Multimed. Syst. J. 11, 1 (Nov.), 68--81.
[11]
Hsu, C. and Hefeeda, M. 2006a. On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences. Tech. Rep. TR 2006-12, Simon Fraser University. (Aug.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)
[12]
Hsu, C. and Hefeeda, M. 2006b. Optimal bit allocation for fine-grained scalable video sequences in distributed streaming environments. Tech. Rep. TR 2006-20, Simon Fraser University. (July.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)
[13]
ISO/IEC 14496-2. 2004. Coding of audio-visual objects - Part 2: Visual.
[14]
ISO/IEC 14496-5. 2004. MPEG-4 Visual reference software.
[15]
Li, W. 2001. Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans. Circ. Syst. Video Tech. 11, 3 (Mar.), 301--317.
[16]
Magharei, N. and Rejaie, R. 2006. Adaptive receiver-driven streaming from multiple senders. ACM/Springer Multimed. Syst. J. 11, 6 (Apr.), 1--18.
[17]
Marler, R. and Arora, J. 2004. Survey of multi-objective optimization methods for engineering. Struct. Multidisc. Optimiz. 26, 6 (Apr.), 369--395.
[18]
Nguyen, T. and Zakhor, A. 2002. Distributed video streaming over Internet. In Proceedings of the Multimedia Computing and Networking (MMCN'02) (San Jose, CA).
[19]
Papadimitriou, C. and Steiglitz, K. 1998. Combinatorial Optimization: Algorithms and Complexity, 1st ed. Dover.
[20]
Radha, H., van der Schaar, M., and Chen, Y. 2001. The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP. IEEE Trans. Multimed. 3, 1 (Mar.), 53--68.
[21]
Schwarz, H., Marpe, D., and Wiegand, T. 2006. The scalable H.264/MPEG4-AVC extension: Technology and applications. In Proceedings of the European Symposium on Mobile Media Delivery (EuMob'06) (Sardinia, Italy).
[22]
Sermadevi, Y. and Hemami, S. 2003. Linear programming optimization for video coding under multiple constraints. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT).
[23]
Su, X. and Wang, T. 2006. Sequence of linear programming for transmission of fine-scalable coded content in bandwidth-limited environments. ACM/Springer Multimed. Syst. J. 11, 5 (June), 455--466.
[24]
Sun, J., Gao, W., Zhao, D., and Huang, Q. 2005. Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos. In Proceedings of the SPIE International Conference on Visual Communication and Image Processing (VCIP'05) (Beijing, China).
[25]
Wang, Y., Ostermann, J., and Zhang, Y. 2002. Video Processing and Communications. Prentice Hall, Englewood Cliffs, NJ.
[26]
Web Page of Network Systems Lab. 2006. http://nsl.cs.surrey.sfu.ca/projects/fgs/.
[27]
Zhang, X., Vetro, A., Shi, Y., and Sun, H. 2003. Constant quality constrained rate allocation for FGS-coded video. IEEE Trans. Circ. Syst. Video Tech. 13, 2 (Feb.), 121--130.
[28]
Zink, M., Künzel, O., Schmitt, J., and Steinmetz, R. 2003. Subjective impression of variations in layer encoded videos. In Proceedings of the the IEEE International Workshop on Quality of Service (IWQoS'03) (Monterey, CA).

Cited By

View all
  • (2021)Streaming Coded Video in P2P NetworksResearch Anthology on Recent Trends, Tools, and Implications of Computer Programming10.4018/978-1-7998-3016-0.ch060(1304-1339)Online publication date: 2021
  • (2015)Neuro Fuzzy based user queries categorization2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS)10.1109/ICIIECS.2015.7193133(1-7)Online publication date: Mar-2015
  • (2015)Distortion minimize of streaming video in multiclient network2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS)10.1109/ICIIECS.2015.7193047(1-5)Online publication date: Mar-2015
  • Show More Cited By

Index Terms

  1. Rate-distortion optimized streaming of fine-grained scalable video sequences

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Multimedia Computing, Communications, and Applications
      ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 4, Issue 1
      January 2008
      197 pages
      ISSN:1551-6857
      EISSN:1551-6865
      DOI:10.1145/1324287
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 February 2008
      Accepted: 01 June 2007
      Revised: 01 February 2007
      Received: 01 November 2006
      Published in TOMM Volume 4, Issue 1

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. FGS
      2. Fine-grained scalable streaming
      3. distributed streaming
      4. peer-to-peer streaming
      5. rate-distortion models
      6. rate-distortion optimized streaming
      7. video streaming

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 14 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)Streaming Coded Video in P2P NetworksResearch Anthology on Recent Trends, Tools, and Implications of Computer Programming10.4018/978-1-7998-3016-0.ch060(1304-1339)Online publication date: 2021
      • (2015)Neuro Fuzzy based user queries categorization2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS)10.1109/ICIIECS.2015.7193133(1-7)Online publication date: Mar-2015
      • (2015)Distortion minimize of streaming video in multiclient network2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS)10.1109/ICIIECS.2015.7193047(1-5)Online publication date: Mar-2015
      • (2015)Achieving maximum utilization of peer’s upload capacity in p2p networks using SVCPeer-to-Peer Networking and Applications10.1007/s12083-015-0406-310:1(45-65)Online publication date: 23-Aug-2015
      • (2014)In-Network Quality Optimization for Adaptive Video Streaming ServicesIEEE Transactions on Multimedia10.1109/TMM.2014.236285616:8(2281-2293)Online publication date: Dec-2014
      • (2013)New scalable modalities in multi-view 3D videoProceedings of the 5th Workshop on Mobile Video10.1145/2457413.2457420(25-30)Online publication date: 27-Feb-2013
      • (2013)Distortion-aware scalable video streaming to multinetwork clientsIEEE/ACM Transactions on Networking10.1109/TNET.2012.220360821:2(469-481)Online publication date: 1-Apr-2013
      • (2013)Capacity Management of Seed Servers in Peer-to-Peer Streaming Systems With Scalable Video StreamsIEEE Transactions on Multimedia10.1109/TMM.2012.222504215:1(181-194)Online publication date: 1-Jan-2013
      • (2012)SwiftProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/2207676.2207766(637-646)Online publication date: 5-May-2012
      • (2011)Scalable video streaming over P2P networks: A matter of harmony?2011 IEEE 16th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD)10.1109/CAMAD.2011.5941101(127-132)Online publication date: Jun-2011
      • Show More Cited By

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media