More Web Proxy on the site http://driver.im/

article

Scalable and fault-tolerant support for variable bit-rate data in the exedra streaming server

Authors:

Stergios V. Anastasiadis,

Kenneth C. Sevcik,

Michael StummAuthors Info & Claims

ACM Transactions on Storage (TOS), Volume 1, Issue 4

Pages 419 - 456

https://doi.org/10.1145/1111609.1111611

Published: 01 November 2005 Publication History

Abstract

We describe the design and implementation of the Exedra continuous media server, and experimentally evaluate alternative resource management policies using a prototype system that we built. Exedra has been designed to provide scalable and efficient support for variable bit-rate media streams whose compression efficiency leads to reduced storage space and bandwidth requirements in comparison to constant bit-rate streams of equivalent quality. We examine alternative disk striping policies, and quantify the benefits of innovative techniques for storage space allocation, buffer management, and resource reservation, which we developed to achieve both predictability and high-performance in handling disk and network data transfers of variable size. Additionally, we investigate the differences between diverse data replication schemes over disk arrays, and compare methods for disk access time reservation that enable tolerance of disk failures at minimal cost. Overall, we demonstrate the feasibility of building network media servers that exploit the latest advances in media compression technology towards reducing the cost of wide-scale streaming services for stored data.

References

[1]

Almeida, J. M., Krueger, J., Eager, D. L., and Vernon, M. K. 2001. Analysis of educational media server workloads. In Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video (Port Jefferson, NY). 21--30.

[2]

Alvarez, G. A., Borowsky, E., Go, S., Romer, T. H., Becker-Szendy, R., Golding, R., Merchant, A., Spasojevic, M., Veitch, A., and Wilkes, J. 2001. Minerva: An automated resource provisioning tool for large-scale storage systems. ACM Trans. Comput. Syst. 19, 4, 483--518.

[3]

Anastasiadis, S. V. 2001. Scalable support for variable bit-rate streams in a continuous media server. Ph.D. thesis, Department of Computer Science, University of Toronto, Toronto, ON, Canada.

[4]

Anastasiadis, S. V., Sevcik, K. C., and Stumm, M. 2001a. Disk striping scalability in the exedra media server. In Proceedings of the ACM/SPIE Multimedia Computing and Networking Conference (San Jose, CA). ACM, New York, 175--189.

[5]

Anastasiadis, S. V., Sevcik, K. C., and Stumm, M. 2001b. Modular and efficient resource management in the exedra media server. In Proceedings of the USENIX Symposium on Internet Technologies and Systems (San Francisco, CA). 25--36.

[6]

Anastasiadis, S. V., Sevcik, K. C., and Stumm, M. 2002. Maximizing throughput in replicated disk striping of variable bit-rate streams. In Proceedings of the USENIX Annual Technical Conference (Monterey, CA). 191--204.

[7]

Anastasiadis, S. V., Sevcik, K. C., and Stumm, M. 2005. Shared-buffer smoothing of variable bit-rate streams. Perf. Eval. 59, 1 (Jan.), 47--72.

[8]

Berson, S., Golubchik, L., and Muntz, R. R. 1995. Fault tolerant design of multimedia servers. In Proceedings of the ACM SIGMOD Conference (San Jose, CA), ACM, New York, 364--375.

[9]

Biersack, E., Thiesse, F., and Bernhardt, C. 1996. Constant data length retrieval for video servers with variable bit rate streams. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Hiroshima, Japan), IEEE Computer Society Press, Los Alamitos, CA, 151--155.

[10]

Birk, Y. 1997. Random raids with selective exploitation of redundancy for high performance video servers. In Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video (Zushi, Japan). 13--23.

[11]

Birrel, A. D. and Needham, R. M. 1980. A universal file server. IEEE Trans. Softw. Eng. 6, 5 (Sept.), 450--453.

[12]

Bitton, D. and Gray, J. 1988. Disk shadowing. In Proceedings of the Very Large Data Base Conference (Los Angeles, CA). 331--338.

[13]

Bolosky, W. J., Barrera, J. S., Draves, R. P., Fitzgerald, R. P., Gibson, G. A., Jones, M. B., Levi, S. P., Myhrvold, N. P., and Rashid, R. F. 1996. The tiger video fileserver. In Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video (Zushi, Japan). 97--104.

[14]

Bolosky, W. J., Fitzgerald, R. P., and Douceur, J. R. 1997. Distributed schedule management in the tiger video fileserver. In Proceedings of the ACM Symposium on Operating Systems Principles (Saint-Malo, France). 212--223.

[15]

Bradshaw, M. K., Wang, B., Sen, S., Gao, L., Kurose, J., Shenoy, P., and Towsley, D. 2003. Periodic broadcast and patching services---implementation, measurement, and analysis in an internet streaming video testbed. Multimed. Syst. 9, 1 (July), 78--93.

[16]

Buddhikot, M. M. and Parulkar, G. M. 1995. Efficient data layout, scheduling and playout control in mars. In Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video (Durham, NH). 318--329.

[17]

Cabrera, L.-F. and Long, D. D. E. 1991. Swift: Using distributed disk striping to provide high I/O data rates. Comput. Syst. 4, 4, 405--436.

[18]

Chang, E. and Zakhor, A. 1994. Scalable video data placement on parallel disk arrays. In Proceedings of the IS&T/SPIE International Symposium on Electronic Imaging: Image and Video Databases (San Jose, CA). 208--221.

[19]

Chang, E. and Zakhor, A. 1996. Cost analyses for VBR video servers. IEEE Multimed. 56--71.

[20]

Chang, E. and Zakhor, A. 1997. Disk-based storage for scalable video. IEEE Trans. Circ. Syst. Video Tech. 5 (Oct.), 758--770.

[21]

Chen, P. M., Lee, E. K., Gibson, G. A., Katz, R. H., and Patterson, D. A. 1994. Raid: High-performance, reliable secondary storage. ACM Comput. Surv. 26, 2 (June), 145--185.

[22]

Clark, T. 1999. Designing Storage Area Networks. Addison-Wesley, Reading, MA.

[23]

Eager, D. L., Vernon, M. K., and Zahorjan, J. 2001. Minimizing bandwidth requirements for on-demand data delivery. IEEE Trans. Knowl. Data Eng. 13, 5 (Sept-Oct), 742--757.

[24]

Flynn, R. and Tetzlaff, W. 1996. Disk striping and block replication algorithms for video file servers. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Hiroshima, Japan), IEEE Computer Society Press, Los Alamitos, CA, 590--597.

[25]

Gafsi, J. and Biersack, E. W. 2000. Modeling and performance comparison of reliability strategies for distributed video servers. IEEE Trans. Parall. Distrib. Syst. 11, 4 (Apr.), 412--430.

[26]

Ganger, G. R., Worthington, B. L., and Patt, Y. N. 1999. The disksim simulation environment: Version 2.0 reference manual. Tech. Rep. CSE-TR-358-98, Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI. Dec.

[27]

Garofalakis, M. N., Ioannidis, Y. E., and Ozden, B. 1998. Resource scheduling for composite multimedia objects. In Proceedings of the Very Large Data Bases Conference (New York, NY). 74--85.

[28]

Gray, J. and Shenoy, P. 2000. Rules of thumb in data engineering. In Proceedings of the IEEE International Conference on Data Engineering (San Diego, CA). IEEE Computer Society Press, Los Alamitos, CA, 3--10.

[29]

Gringeri, S., Shuaib, K., Egorov, R., Lewis, A., Khasnabish, B., and Basch, B. 1998. Traffic shaping, bandwidth allocation, and quality assessment for MPEG video distribution over broadband networks. IEEE Netw. 6 (Nov./Dec.), 94--107.

[30]

Grochowski, E. and Halem, R. D. 2003. Technological impact of magnetic hard disk drives on storage systems. IBM Syst. J. 42, 2, 338--346.

[31]

Haskin, R. L. and Schmuck, F. B. 1996. The tiger shark file system. In Proceedings of the IEEE COMPCON (Santa Clara, CA). IEEE Computer Society Press, Los Alamitos, CA, 226--231.

[32]

Hsiao, H.-I. and DeWitt, D. J. 1990. Chained declustering: A new availability strategy for multiprocessor database machines. In Proceedings of the IEEE International Conference on Data Engineering (Los Angeles, CA). IEEE Computer Society Press, Los Alamitos, CA, 456--465.

[33]

IBM. 1994. The IBM Dictionary of Computing. McGraw-Hill, New York, NY.

[34]

Lakshman, T. V., Ortega, A., and Reibman, A. R. 1998. VBR video: Tradeoffs and potentials. Proce. IEEE 86, 5 (May), 952--973.

[35]

Makaroff, D., Hutchinson, N., and Neufeld, G. 1997. An evaluation of VBR disk admission algorithms for continuous media file servers. In Proceedings of the ACM International Conference on Multimedia (Seattle, WA). ACM, New York, 143--154.

[36]

Martin, C., Narayanan, P. S., Ozden, B., Rastogi, R., and Silberschatz, A. 1996. The Fellini multimedia storage system. In Multimedia Information Storage and Management, S.M.Chung, Ed. Kluwer Academic Publishers, Boston, MA.

[37]

McKusick, M. K., Joy, W. N., Leffler, S., and Fabry, R. S. 1984. A fast file system for UNIX. ACM Trans. Comput. Syst. 2, 3 (Aug.), 181--197.

[38]

McVoy, L. and Kleiman, S. R. 1991. Extent-like performance from a UNIX file system. In Proceedings of the USENIX Winter Technical Conference (Dallas, TX). 33--43.

[39]

Merchant, A. and Yu, P. S. 1995. Analytic modeling and comparisons of striping strategies for replicated disk arrays. IEEE Trans. Comput. 44, 3 (Mar.).

[40]

Microsoft. 2003. Choosing an encoding method, Windows Media 9 series, development network library. http://msdn.microsoft.com/library/default.asp?url=/library/en-us/wmform/htm/choosinganencodingmethod.asp.

[41]

Mourad, A. 1996. Doubly-striped disk mirroring: Reliable storage for video servers. Multimed. Tools Applic. 2, 273--297.

[42]

Muntz, R., Santos, J. R., and Berson, S. 1998. A parallel disk storage system for real-time multimedia applications. Int. J. Intelligent Systems 13, 12 (Dec.), 1137--1174.

[43]

Nagle, D., Serenyi, D., and Matthews, A. 2004. The panasas activescale storage cluster---Delivering scalable high bandwidth storage. In Proceedings of the ACM/IEEE Conference on Supercomputing (Pittsburgh, PA). ACM, New York, 53.

[44]

Neufeld, G., Makaroff, D., and Hutchinson, N. 1996. Design of a variable bit rate continuous media file server for an atm network. In Proceedings of the IS&T/SPIE Multimedia Computing and Networking Conference (San Jose, CA), 370--380.

[45]

Ng, S. W. 1998. Advances in disk technology: Performance issues. Computer 31, 15 (May), 75--81.

[46]

Nieuwejaar, N., Kotz, D., Purakayastha, A., Ellis, C. S., and Best, M. L. 1996. File-access characteristics of parallel scientific workloads. IEEE Trans. Paral. Distrib. Syst. 7, 10 (Oct.), 1075--1089.

[47]

Ozden, B., Rastogi, R., and Silberschatz, A. 1996. Disk striping in video server environments. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Hiroshima, Japan). IEEE Computer Society Press, Los Alamitos, CA, 580--589.

[48]

Reddy, A. L. N. and Wijayaratne, R. 1999. Techniques for improving the throughput of vbr streams. In Proceedings of the IEEE ACM/SPIE Multimedia Computing and Networking Conference (San Jose, CA). 216--227.

[49]

Ruemmler, C. and Wilkes, J. 1994. An introduction to disk drive modeling. Computer 27, 3 (Mar.), 17--28.

[50]

Santos, J. R., Muntz, R. R., and Ribeiro-Neto, B. 2000. Comparing random data allocation and data striping in multimedia servers. In Proceedings of the ACM SIGMETRICS (Santa Clara, CA). ACM, New York, 44--55.

[51]

Sen, P., Maglaris, B., Rikli, N., and Anastassiou, D. 1989. Models for packet switching of variable bit-rate video sources. IEEE J. Selec. Areas Commun. 7, 5 (June), 865--869.

[52]

Sen, S., Dey, J., Kurose, J., Stankovic, J., and Towsley, D. 1997. Streaming CBR transmission of VBR stored video. In Proceedings of the SPIE Symposium on Voice, Video and Data Communications (Dallas, TX). 26--36.

[53]

Shenoy, P. J., Goyal, P., Rao, S. S., and Vin, H. M. 1998. Symphony: An integrated multimedia file system. In Proceedings of the ACM/SPIE Multimedia Computing and Networking Conference (San Jose, CA). ACM, New York, 124--138.

[54]

Shenoy, P. J. and Vin, H. M. 1999. Efficient striping techniques for multimedia file servers. Perf. Eval. 38, 3--4 (Oct.), 175--199.

[55]

Shenoy, P. J. and Vin, H. M. 2000. Failure recovery algorithms for multimedia servers. Multimed. Syst. J. 8, 1 (Jan.), 1--19.

[56]

Tewari, R., Dias, D. M., Mukherjee, R., and Vin, H. M. 1996. High availability in clustered multimedia servers. In Proceedings of the IEEE International Conference on Data Engineering (New Orleans, LA). IEEE Computer Society Press, Los Alamitos, CA, 336--342.

[57]

Thirumalai, K., Paris, J.-F., and Long, D. D. E. 2003. Tabbycat: an inexpensive scalable server for video-on-demand. In Proceedings of the IEEE International Conference on Communications. (Anchorage, AK). IEEE Computer Society Press, Los Alamitos, CA, 896--900.

[58]

Tobagi, F. A., Pang, J., Baird, R., and Gang, M. 1993. Streaming raid---A disk array management system for video files. In ACM International Conference on Multimedia (Anaheim, CA). ACM, New York, 393--400.

[59]

Triantafillou, P. and Harizopoulos, S. 1999. Prefetching into smart-disk caches for high performance media server. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems (Florence, Italy). IEEE Computer Society Press, Los Alamitos, CA, 800--805.

[60]

Verbiest, W., Pinnoo, L., and Voeten, B. 1988. The impact of the ATM concept on video coding. IEEE J. Sel. Areas Commun. 6, 9 (Dec.), 1623--1632.

Cited By

Kim HYeom HKang SWon Y(2010)Inter-Object Layer Clustering for scalable video streamingMultimedia Tools and Applications10.1007/s11042-009-0384-750:2(313-333)Online publication date: 1-Nov-2010
https://dl.acm.org/doi/10.1007/s11042-009-0384-7
Kang SHong SWon Y(2008)Storage technique for real-time streaming of layered videoMultimedia Systems10.1007/s00530-008-0147-815:2(63-81)Online publication date: 10-Dec-2008
https://doi.org/10.1007/s00530-008-0147-8
Ge ZJi PShenoy P(2007)Design and analysis of a demand adaptive and locality aware streaming media server clusterMultimedia Systems10.1007/s00530-007-0092-y13:3(235-249)Online publication date: 1-Sep-2007
https://dl.acm.org/doi/10.1007/s00530-007-0092-y

Index Terms

Scalable and fault-tolerant support for variable bit-rate data in the exedra streaming server

Recommendations

Supporting variable bit-rate streams in a scalable continuous media server
Video Server Retrieval Scheduling for Variable Bit Rate Scalable Video
ICMCS '96: Proceedings of the 1996 International Conference on Multimedia Computing and Systems

In advanced multimedia networks, video servers with real time operating systems and high performance storage architectures will deliver multiple concurrent video streams to clients. The video server has a limited disk I/O band width. This research ...
Shared-buffer smoothing of variable bit-rate streams

We study network servers that transmit variable bit-rate streams for real-time playback at remote clients. We introduce an algorithm that removes peaks of disk bandwidth by prefetching stored stream data into the shared buffer space of the server. Using ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Storage

ACM Transactions on Storage Volume 1, Issue 4

November 2005

100 pages

ISSN:1553-3077

EISSN:1553-3093

DOI:10.1145/1111609

Issue’s Table of Contents

Copyright © 2005 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2005

Published in TOS Volume 1, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
582
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim HYeom HKang SWon Y(2010)Inter-Object Layer Clustering for scalable video streamingMultimedia Tools and Applications10.1007/s11042-009-0384-750:2(313-333)Online publication date: 1-Nov-2010
https://dl.acm.org/doi/10.1007/s11042-009-0384-7
Kang SHong SWon Y(2008)Storage technique for real-time streaming of layered videoMultimedia Systems10.1007/s00530-008-0147-815:2(63-81)Online publication date: 10-Dec-2008
https://doi.org/10.1007/s00530-008-0147-8
Ge ZJi PShenoy P(2007)Design and analysis of a demand adaptive and locality aware streaming media server clusterMultimedia Systems10.1007/s00530-007-0092-y13:3(235-249)Online publication date: 1-Sep-2007
https://dl.acm.org/doi/10.1007/s00530-007-0092-y

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents