[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Optimal Read-Once Parallel Disk Scheduling

Published: 01 December 2005 Publication History

Abstract

An optimal prefetching and I/O scheduling algorithm L-OPT, for parallel I/O systems, using a read-once model of block references is presented. The algorithm uses knowledge of the next $L$ references, $L$-block lookahead, to create a minimal-length I/O schedule. For a system with $D$ disks and a buffer of capacity $m$ blocks, we show that the competitive ratio of L-OPT is $\Theta(\sqrt{mD/L})$ when $L \geq m$, which matches the lower bound of any prefetching algorithm with $L$-block lookahead. Tight bounds for the remaining ranges of lookahead are also presented. In addition we show that L-OPT is the optimal offline algorithm: when the lookahead consists of the entire reference string, it performs the absolute minimum possible number of I/Os. Finally, we show that L-OPT is comparable with the best online algorithm with the same amount of lookahead; the ratio of the length of its schedule to the length of the optimal schedule is always within a constant factor.

References

[1]
S. Albers. The influence of lookahead in competitive paging algorithms. In Proceedings of the 1st Annual European Symposium on Algorithms, pages 1-12. Volume 726 of LNCS, Springer-Verlag, Berlin, 1993.
[2]
S. Albers, N. Garg, and S. Leonardi. Minimizing stall time in single and parallel disk systems. Journal of the ACM, 47:969-986, 2000.
[3]
R. D. Barve, E. F. Grove, and J. S. Vitter. Simple randomized mergesort on parallel disks. Parallel Computing, 23(4):601-631, June 1996.
[4]
R. D. Barve, M. Kallahalla, P. J. Varman, and J. S. Vitter. Competitive parallel disk prefetching and buffer management. Journal of Algorithms, 36:152-181, July 2000.
[5]
P. Cao, E.W. Felten, A. R. Karlin, and K. Li. A study of integrated prefetching and caching strategies. In Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems, pages 188-197. ACM Press, New York, May 1995.
[6]
F. Chang and G. A. Gibson. Automatic hint generation through speculative execution. In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation, pages 1-14, February 1999.
[7]
P. M. Chen, E. K. Lee, G. A. Gibson, R. H. Katz, and D. A. Patterson. RAID: high performance reliable secondary storage. ACM Computing Surveys, 26(2):145-185, 1994.
[8]
D. A. Hutchinson, P. Sanders, and J. S. Vitter. The power of duality for prefetching and sorting with parallel disks. In Proceedings of the 13th Annual ACM Symposium on Parallel Algorithms and Architectures, pages 334-335, July 2001.
[9]
D. A. Hutchinson, P. Sanders, and J. S. Vitter. Duality between prefetching and queued writing with parallel disks. In Proceedings of Ninth European Symposium on Algorithms, pages 62-73. Volume 2161 of LNCS. Springer-Verlag, Berlin, 2002.
[10]
M. Kallahalla. Competitive prefetching and buffer management for parallel I/O systems. Master's thesis, Rice University, May 1997.
[11]
M. Kallahalla. Scheduling and buffer management for parallel I/O systems. Ph.D. thesis, Rice University, October 2000.
[12]
M. Kallahalla and P. J. Varman. Red-black prefetching: an approximation algorithm for parallel disk scheduling. In Foundations of Software Technology and Theoretical Computer Science, pages 66-77. Volume 1530 of LNCS, Springer-Verlag, Berlin, December 1998.
[13]
M. Kallahalla and P. J. Varman. Optimal read-once parallel disk scheduling. In Proceedings of the Sixth ACM Workshop on I/O in Parallel and Distributed Systems, pages 68-77, Atlanta, GA, 1999. ACM Press, New York, 1999.
[14]
M. Kallahalla and P. J. Varman. Randomized parallel prefetching and buffer management. In P. M. Pardalos and S. Rajasekaran, editors, Advances in Randomized Parallel Computing, chapter 9, pages 183-208. Kluwer, Dordrecht, 1999.
[15]
M. Kallahalla and P. J. Varman. Optimal prefetching and caching for parallel I/O systems. In Proceedings of the 13th Annual ACM Symposium on Parallel Algorithms and Architectures, pages 219-228, July 2001.
[16]
M. Kallahalla and P. J. Varman. PC-OPT: optimal offline prefetching and caching for parallel I/O systems. IEEE Transactions on Computers, 51(11):1333-1344, November 2002.
[17]
A. R. Karlin, M. S. Manasse, L. Rudolph, and D. D. Sleator. Competitive snoopy caching. Algorithmica, 5(3):79-119, March 1988.
[18]
T. Kimbrel and A. R. Karlin. Near-optimal parallel prefetching and caching. SIAM Journal of Computing, 29:1051-1082, 2000.
[19]
D. Kotz and C. S. Ellis. Practical prefetching techniques for parallel file systems. In Proceedings of the First International Conference on Parallel and Distributed Information Systems, pages 182-189, December 1991.
[20]
E. Koutsoupias and C. H. Papadimitriou. Beyond competitive analysis. In Proceedings of the 35th Annual Symposium on Foundations of Computer Science, pages 394-400. IEEE, New York, November 1994.
[21]
K. K. Lee, M. Kallahalla, B. S. Lee, and P. J. Varman. Performance comparison of sequential prefetch and forecasting using parallel I/O. Journal of Parallel and Distributed Systems and Networks, 5(2):76-84, February 2002.
[22]
V. S. Pai, A. A. Schäffer, and P. J. Varman. Markov analysis of multiple-disk prefetching strategies for external merging. Theoretical Computer Science, 128(1-2):211-239, June 1994.
[23]
R. H. Patterson, G. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka. Informed prefetching and caching. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, pages 79-95, December 1995.
[24]
P. Sanders, S. Egner, and J. H. M. Korst. Fast concurrent access to parallel disks. In Proceedings of 11th ACM-SIAM Symposium on Discrete Algorithms, pages 849-858, January 2000.
[25]
R. Shah, P. J. Varman, and J. S. Vitter. Online algorithms for prefetching and caching on parallel disks. In Proceedings of the 16th Annual ACM Symposium on Parallelism in Algorithms and Architectures, pages 255-264, June 2004.
[26]
D. D. Sleator and R. E. Tarjan. Amortized efficiency of list update and paging rules. Communications of the ACM, 28(2):202-208, February 1985.
[27]
P. J. Varman and R. M. Verma. Tight bounds for prefetching and buffer management algorithms for parallel I/O systems. IEEE Transactions on Parallel and Distributed Systems, 10:1262-1275, December 1999.
[28]
J. S. Vitter and E. A. M. Shriver. Optimal algorithms for parallel memory, I: Two-level memories. Algorithmica, 12(2-3):110-147, 1994.
[29]
L. Q. Zheng and P. Å. Larson. Speeding up external mergesort. IEEE Transactions on Knowledge and Data Engineering, 8(2):322-332, April 1996.

Cited By

View all
  • (2008)Algorithms and data structures for external memoryFoundations and Trends® in Theoretical Computer Science10.1561/04000000142:4(305-474)Online publication date: 1-Jan-2008

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Algorithmica
Algorithmica  Volume 43, Issue 4
December 2005
97 pages

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 December 2005

Author Tags

  1. Caching
  2. External memory algorithms
  3. Parallel I/O
  4. Prefetching
  5. Scheduling

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2008)Algorithms and data structures for external memoryFoundations and Trends® in Theoretical Computer Science10.1561/04000000142:4(305-474)Online publication date: 1-Jan-2008

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media