[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content

Co-Allocation in Grids: Experiences and Issues

  • Chapter
Future Generation Grids

Abstract

Jobs submitted to a grid may require more resources than those available at any time in any single subsystem making up a grid. Therefore, grid schedulers may employ co-allocation, that is, the simultaneous allocation of possibly multiple resources in multiple subsystems to a single job. Over the last few years we have done extensive simulations of processor co-allocation, and we have built a grid scheduler called KOALA that employs data and processor co-allocation. In this paper we summarize our experiences with co-allocation, and we review some the main issues that still remain before co-allocation can be considered an accepted solution in future-generation grids.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 103.50
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 129.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
GBP 129.99
Price includes VAT (United Kingdom)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. The Advanced School for Computing and Imaging. www.asci.tudelft.nl.

    Google Scholar 

  2. H.E. Bal and D.H.J. Epema et al. The Distributed ASCI Supercomputer Project. ACM Operating Systems Review, 34(4):76–96, 2000.

    Article  Google Scholar 

  3. S. Banen, A.I.D. Bucur, and D.H.J. Epema. A Measurement-Based Simulation Study of Processor Co-Allocation in Multicluster Systems. In D.G. Feitelson, L. Rudolph, and U. Schwiegelshohn, editors, Proc. of the 9th Workshop on Job Scheduling Strategies for Parallel Processing, volume 2862 of LNCS, pages 105–128. Springer-Verlag, 2003.

    Google Scholar 

  4. R. Baxter and N. Chue Hong. Bringing the Grid to the Biomedical Workbench. In Proc. of the 11th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-11), 2002.

    Google Scholar 

  5. R.G. Belleman and R. Shulakov. High Performance Distributed Simulation for Interactive Simulated Vascular Reconstruction. In P.M.A. Sloot, C.J. Kenneth Tan, Jack J. Dongarra, and Alfons G. Hoekstra, editors, International Conference on Computational Science (ICCS), Amsterdam, the Netherlands, volume 2331 of LNCS, pages 265–274, Berlin, April 2002. Springer-Verlag.

    Google Scholar 

  6. A.I.D. Bucur and D.H.J. Epema. Priorities among Multiple Queues for Processor Co-Allocation in Multicluster Systems. In Proc. of the 36th Annual Simulation Symp., pages 15–27. IEEE Computer Society Press, 2003.

    Google Scholar 

  7. A.I.D. Bucur and D.H.J. Epema. The Performance of Processor Co-Allocation in Multicluster Systems. In Proc. of the 3rd IEEE/ACM Int’l Symp. on Cluster Computing and the GRID (CCGrid2003), pages 302–309. IEEE Computer Society Press, 2003.

    Google Scholar 

  8. A.I.D. Bucur and D.H.J. Epema. Trace-Based Simulations of Processor Co-Allocation Policies in Multiclusters. In Proc. of the 12th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-12), pages 70–79. IEEE Computer Society Press, 2003.

    Google Scholar 

  9. A.I.D. Bucur, R. Kootstra, and R.G. Belleman. A Grid Architecture for Medical Applications. In To appear in Proc. of the 3rd HealthGrid Conference, pages 241–252, 2005.

    Google Scholar 

  10. K. Czajkowski, I. Foster, and C. Kesselman. Resource Co-Allocation in Computational Grids. In Proc. of the 8th IEEE Int’l Symp. on High Performance Distributed Computing (HPDC-8), pages 219–228, 1999.

    Google Scholar 

  11. The Distributed ASCI Supercomputer (DAS). www.cs.vu.nl/das2.

    Google Scholar 

  12. C. Ernemann, V. Hamscher, U. Schwiegelshohn, R. Yahyapour, and A. Streit. On Advantages of Grid Computing for Parallel Job Scheduling. In Proc. of the 2nd IEEE/ACM Int’ I Symp. on Cluster Computing and the GRID (CCGrid2002), pages 39–46, 2002.

    Google Scholar 

  13. F. van Hees, A.J. van der Steen, and P.J. van Leeuwen. A Parallel Data Assimilation Model for Oceanographic Observations. Concurrency and Computation: Practice and Experience, 15:1191–1204, 2003.

    Article  Google Scholar 

  14. The Globus Toolkit, www.globus.org.

    Google Scholar 

  15. GridLab. www.gridlab.org.

    Google Scholar 

  16. H.H. Mohamed and D.H.J. Epema. The Design and Implementation of the KOALA Co-Allocating Scheduler. In European Grid Conference, 2005.

    Google Scholar 

  17. H.H. Mohamed and D.H.J. Epema. Experiences with the KOALA Co-Allocating Scheduler in Multiclusters. In 5th IEEE/ACM Int’l Symp. on Cluster Computing and the GRID (CCGrid2005), 2005.

    Google Scholar 

  18. Iperf Version 1.7.0. http://dast.nlanr.net/Projects/Iperf/.

    Google Scholar 

  19. N. Kang, J. Zhang, and E.S. Carlson. Parallel Computation in Simulating Diffusion and Deformation in Human Brain. Technical Report 418-04, Dept. of Comp. Science, Univ. of Kentucky, 2004.

    Google Scholar 

  20. Joy P. Ku, Mary T. Draney, Frank R. Arko, W. Anthony Lee, Frandics P. Chan, Norbert J. Pelc, Christopher K. Zarins, and Charles A. Taylor. In Vivo Validation of Numerical Prediction of Blood Flow in Arterial Bypass Grafts. Annals of Biomedical Engineering, 30:743–752, 2002.

    Article  Google Scholar 

  21. H.H. Mohamed and D.H.J. Epema. An Evaluation of the Close-to-Files Processor and Data Co-Allocation Policy in Multiclusters. In CLUSTER 2004, IEEE Int’l Conf. on Cluster Computing, pages 287–298, 2004.

    Google Scholar 

  22. S. Mori and P.C. van Zijl. Fiber Tracking: Principles and Strategies—a Technical Review. NMR Biomed, 15(7–8):468–480, 2002.

    Article  Google Scholar 

  23. Novartis Institute for BioMedical Research. www.nibr.novartis.com.

    Google Scholar 

  24. Seti@home. www.setiathome.ssl.berkeley.edu.

    Google Scholar 

  25. The Sun Grid Engine. http://gridengine.sunsource.net.

    Google Scholar 

  26. T. Röblitz, F. Schintke, and J. Wendler. Elastic Grid Reservations with User-Defined Optimization Policies. In Workshop on Adaptive Grid Middleware (AGridM’04), 2004.

    Google Scholar 

  27. R. V. van Nieuwpoort, J. Maassen, H.E. Bal, T. Kielmann, and R. Veldema. Wide-Area Parallel Programming Using the Remote Method Invocation Method. Concurrency: Practice and Experience, 12(8):643–666, 2000.

    Article  MATH  Google Scholar 

  28. R.V. van Nieuwpoort, J. Mason, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H.E. Bal. Ibis: A Flexible and Efficient Java-based Grid Programming Environment. Concurrency and Computation: Practice and Experience, 17:1079–1107, 2005.

    Article  Google Scholar 

  29. F.M. Vos, R.E. van Gelder, I.W.O. Serlie, J. Florie, C.Y. Nio, A.S. Glas, F.H. Post, R. Truyen, F.A. Gerritsen, and J. Stoker. Three-dimensional Display Modes for CT Colonography: Conventional 3D Virtual Colonoscopy versus Unfolded Cube Projection. Radiology, 228:878–885, 2003.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer Science+Business Media, Inc.

About this chapter

Cite this chapter

Bucur, A., Epema, D., Mohamed, H. (2006). Co-Allocation in Grids: Experiences and Issues. In: Getov, V., Laforenza, D., Reinefeld, A. (eds) Future Generation Grids. Springer, Boston, MA . https://doi.org/10.1007/978-0-387-29445-2_11

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-29445-2_11

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-27935-0

  • Online ISBN: 978-0-387-29445-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics