article

A speed-based adaptive dynamic parallel downloading technique

Authors:

Zhou Xu,

Lu Xianliang,

Hou Mengshu,

Zhan ChuanAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 39, Issue 1

Pages 63 - 69

https://doi.org/10.1145/1044552.1044559

Published: 01 January 2005 Publication History

Get Access

Abstract

In this paper, we describe adPD, an improved parallel downloading approach for Peer-to-Peer environment. adPD assigns each server equal portion of file as large as possible, and ensures client downloading from each server without interrupt. And after faster servers finish their own work, adPD reallocates part of unfinished work of some slower servers to them. This reallocation is proportional to the ratio of server speed. By this means, adPD dynamically adjusts the proportion of a file retrieved from each server during the downloading process to match the bandwidth of each connection, and also reduces the number of block requests as many as possible. Our experiment results show that adPD is an effective parallel download scheme in Peer-to-Peer environment.

References

[1]

A. Miu and E. Shih, Performance Analysis of a Dynamic Parallel Downloading Scheme from Mirror Sites Throughout the Internet, url: http://nms.lcs.mit.edu/~aklmiu/comet/paraload.html, December 1999.

Google Scholar

[2]

Pablo Rodriguez, Andreas Kirpal, and Ernst W. Biersack. Parallel-access for mirror sites in the internet. In Proceedings of IEEE INFOCOM 2000, March 2000.

Crossref

Google Scholar

[3]

Speedbit's download accelerator. http://www.speedbit.com

Google Scholar

[4]

Bram Cohen, Incentives Build Robustness in BitTorrent, http://bitconjurer.org/BitTorrent/documentation.html, May, 2003.

Google Scholar

[5]

O. Wolfson, S. Jajodia, and Y. Huang, An adaptive data replication algorithm, ACM Transactions on Database Systems, vol. 22, pp. 255--314, 1997.

Digital Library

Google Scholar

[6]

Musiccity, http://www.musiccity.com

Google Scholar

[7]

"OpenCola Swarmcast", http://www.opencola.org/projects/swarmcast.shtml.

Google Scholar

[8]

Andy Myers, Peter A. Dinda, and Hui Zhang. Performance characteristics of mirror servers on the internet. In INFOCOM (1), pages 304--312, 1999.

Google Scholar

[9]

Christos Gkantsidis, Mostafa Ammar, Ellen Zegura, "On the Effect of Large-Scale Deployment of Parallel Downloading", IEEE Workshop on Internet Applications (WIAPP'03), 2003

Digital Library

Google Scholar

[10]

P. Rodriguez and E. Biersack. Dynamic parallelaccess to replicated content in the Internet. IEEE/ACM Transactions on networking, 10(4), Aug. 2002.

Digital Library

Google Scholar

[11]

S. G. M. Koo, C. Rosenberg, and D. Xu. Analysis of Parallel Downloading for Large File Distribution. In Proceedings of FTDCS 2003, San Juan, Puerto Rico, May 2003

Digital Library

Google Scholar

[12]

A. Zeitoun, H. Jamjoom, and M. El-Gendy. Scalable Parallel-Access For Mirrored Servers. In The 20th IASTED International Conference on Applied Informatics (AI 2002), Innsbruck, Austria, Feb. 2002.

Google Scholar

[13]

Wei Qingsong, The Research on Large-Scale Distributed Storage Technology, Ph. D. Thesis, UESTC, China, 2004

Google Scholar

Cited By

View all

Ranaldo NZimeo E(2012)Optimizing Content Delivery in QoS-Aware Multi-CDNsNext Generation Content Delivery Infrastructures10.4018/978-1-4666-1794-0.ch007(147-171)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-1794-0.ch007
Ma MLee J(2010)Multi-Source Scheduling in Streaming Erasure-Coded Video over P2P Networks2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P)10.1109/P2P.2010.5569964(1-10)Online publication date: Aug-2010
https://doi.org/10.1109/P2P.2010.5569964
Sha NRashmi KKumar P(2010)A flexible class of regenerating codes for distributed storage2010 IEEE International Symposium on Information Theory10.1109/ISIT.2010.5513353(1943-1947)Online publication date: Jun-2010
https://doi.org/10.1109/ISIT.2010.5513353
Show More Cited By

Index Terms

Recommendations

A teamwork approach to improving the downloading time in BitTorrent-like systems

It is well known that the content distribution system based on peer-to-peer P2P networks has become the primary means for the majority of internet users to share their files, and that BitTorrent BT, as the most popular technology in P2P systems, ...
Efficient and flexible parallel retrieval using priority encoded transmission
NOSSDAV '04: Proceedings of the 14th international workshop on Network and operating systems support for digital audio and video

Many applications, including web transfers, software distribution, video-on-demand, and peer-to-peer data downloads, require the retrieval of structured documents consisting of multiple components like images, video, and text. Large systems using these ...
An adaptive buffer-map exchange mechanism for pull-based peer-to-peer video-on-demand streaming systems

Unlike P2P live video streaming in which all the peers in a channel watch a video with tiny differences in viewing points, in P2P video on demand (VoD) streaming systems, neighbor peers may watch the same video with more different viewing points; ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 39, Issue 1

January 2005

93 pages

ISSN:0163-5980

DOI:10.1145/1044552

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2005

Published in SIGOPS Volume 39, Issue 1

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
484
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ranaldo NZimeo E(2012)Optimizing Content Delivery in QoS-Aware Multi-CDNsNext Generation Content Delivery Infrastructures10.4018/978-1-4666-1794-0.ch007(147-171)Online publication date: 2012
https://doi.org/10.4018/978-1-4666-1794-0.ch007
Ma MLee J(2010)Multi-Source Scheduling in Streaming Erasure-Coded Video over P2P Networks2010 IEEE Tenth International Conference on Peer-to-Peer Computing (P2P)10.1109/P2P.2010.5569964(1-10)Online publication date: Aug-2010
https://doi.org/10.1109/P2P.2010.5569964
Sha NRashmi KKumar P(2010)A flexible class of regenerating codes for distributed storage2010 IEEE International Symposium on Information Theory10.1109/ISIT.2010.5513353(1943-1947)Online publication date: Jun-2010
https://doi.org/10.1109/ISIT.2010.5513353
Chang RLin CHsi S(2010)Accessing data from many servers simultaneously and adaptively in data gridsFuture Generation Computer Systems10.1016/j.future.2009.07.00526:1(63-71)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.1016/j.future.2009.07.005
Chu CHsu CChang HWang SLi K(2009)Parallel File Transfer for Grid EconomicScalable Information Systems10.1007/978-3-642-10485-5_6(76-89)Online publication date: 2009
https://doi.org/10.1007/978-3-642-10485-5_6
Ruay-Shiung Chang Chun-Fu Lin Jiing-Hsing Ruey Shih-Chun Hsi (2008)An efficient and bandwidth sensitive parallel download scheme in data grids2008 3rd International Conference on Communication Systems Software and Middleware and Workshops (COMSWARE '08)10.1109/COMSWA.2008.4554429(296-301)Online publication date: Jan-2008
https://doi.org/10.1109/COMSWA.2008.4554429
Chang RGuo MLin H(2008)A multiple parallel download scheme with server throughput and client bandwidth considerations for data gridsFuture Generation Computer Systems10.1016/j.future.2008.04.00624:8(798-805)Online publication date: 1-Oct-2008
https://dl.acm.org/doi/10.1016/j.future.2008.04.006
Kapitza RZeman THauck FReiser H(2007)Parallel state transfer in object replication systemsProceedings of the 7th IFIP WG 6.1 international conference on Distributed applications and interoperable systems10.5555/1776132.1776150(167-180)Online publication date: 6-Jun-2007
https://dl.acm.org/doi/10.5555/1776132.1776150
Kapitza RZeman THauck FReiser H(2007)Parallel State Transfer in Object Replication SystemsDistributed Applications and Interoperable Systems10.1007/978-3-540-72883-2_13(167-180)Online publication date: 2007
https://doi.org/10.1007/978-3-540-72883-2_13
Fu JFan H(2006)Assigning Block Size Based on Speculation for Parallel DownloadingProceedings of the Sixth IEEE International Conference on Computer and Information Technology10.1109/CIT.2006.54Online publication date: 20-Sep-2006
https://dl.acm.org/doi/10.1109/CIT.2006.54

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A teamwork approach to improving the downloading time in BitTorrent-like systems

Efficient and flexible parallel retrieval using priority encoded transmission

An adaptive buffer-map exchange mechanism for pull-based peer-to-peer video-on-demand streaming systems