More Web Proxy on the site http://driver.im/

research-article

Pricing for Utility-Driven Resource Management and Allocation in Clusters

Authors:

Rajkumar BuyyaAuthors Info & Claims

International Journal of High Performance Computing Applications, Volume 21, Issue 4

Pages 405 - 418

https://doi.org/10.1177/1094342007083776

Published: 01 November 2007 Publication History

Abstract

Users perceive varying levels of utility for each different job completed by the cluster. Therefore, there is a need for existing cluster resource management systems (RMS) to provide a means for the user to express its perceived utility during job submission. The cluster RMS can then obtain and consider these user-centric needs such as Quality-of-Service requirements in order to achieve utility-driven resource management and allocation. We advocate the use of computational economy for this purpose. In this paper, we describe an architectural framework for a utility-driven cluster RMS. We present a user-level job submission specification for soliciting user-centric information that is used by the cluster RMS for making better resource allocation decisions. In addition, we propose a dynamic pricing function that the cluster owner can use to determine the level of sharing within a cluster. Finally, we define two user-centric performance evaluation metrics: Job QoS Satisfaction and Cluster Profitability for measuring the effectiveness of the proposed pricing function in realizing utility-driven resource management and allocation.

References

[1]

Altair Grid Technologies (2000). OpenPBS Release 2. 3 Administrator Guide, Altair Grid Technologies, August.

[2]

Buyya, R. (ed.) (1999). High Performance Cluster Computing: Architectures and Systems, Prentice Hall PTR, Upper Saddle River, NJ .

Digital Library

[3]

Buyya, R., Abramson, D., and Giddy, J. (2000). An economy driven resource management architecture for global computational power grids, in Proc. of International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA 2000), Las Vegas, NV, June.

[4]

Buyya, R., Abramson, D., and Giddy, J. (2001). A case for economy grid architecture for service oriented grid computing, in Proc. of 10th International Heterogeneous Computing Workshop (HCW 2001), San Francisco, CA, April.

Digital Library

[5]

Buyya, R., Cortes, T., and Jin, H. (2001). single system image, The International Journal of High Performance Computing Applications, 15(2): 124—135 .

Digital Library

[6]

Buyya, R., Giddy, J., and Abramson, D. (2000). An evaluation of economy-based resource trading and scheduling on computational power grids for parameter sweep applications, in Proc. of 2nd Annual Workshop on Active Middle-ware Services (AMS 2000), Pittsburgh, PA, August.

[7]

Buyya, R., Murshed, M., and Abramson, D. (2002). A deadline and budget constrained cost-time optimization algorithm for scheduling task farming applications on global grids, in Proc. of International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA 2002), Las Vegas, NV, June.

[8]

Chun, B.N. and Culler, D.E. (2000a). Market-based proportional resource sharing for clusters, University of California at Berkeley, Computer Science Division, Technical Report CSD-1092, January.

[9]

Chun, B.N. and Culler, D.E. (2000b). REXEC: A decentralized, secure remote execution environment for clusters, in Proc. of 4th Workshop on Communication, Architecture, and Applications for Network-based Parallel Computing (CANPC '00), Toulouse, France, January.

Digital Library

[10]

Chun, B.N. and Culler, D.E. (2002). User-centric performance analysis of market-based cluster batch schedulers, in Proc. of 2nd IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2002), Berlin, Germany, May.

Digital Library

[11]

Feitelson, D.G. (2006). Parallel Workloads Archive, Oct. {Online}. Available: http://www.cs.huji.ac.il/labs/parallel/workload

[12]

Ibm (2003). LoadLeveler for AIX 5L Version 3.2 Using and Administering, SA22-7881-01, IBM, October.

[13]

Irwin, D.E., Grit, L.E., and Chase, J.S. (2004). Balancing risk and reward in a market-based task service, in Proc. of 13th International Symposium of High Performance Distributed Computing (HPDC13), Honolulu, HI, June.

Digital Library

[14]

Lifka, D. (1995). The ANL/IBM SP scheduling system, in Proc. of 1st Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP 1995), Santa Barbara, CA, April.

Digital Library

[15]

Mu'alem, A.W. and Feitelson, D.G. (2001). Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling, IEEE Trans. Parallel and Distributed Systems, 12(6): 529—543 .

Digital Library

[16]

Pfister, G.F. (1998). In Search of Clusters, 2nd ed., Prentice Hall PTR, Upper Saddle River, NJ .

Digital Library

[17]

Platform Computing (2001). LSF Version 4.1 Administrator's Guide, Platform Computing .

[18]

Stonebraker, M., Devine, R., Kornacker, M., Litwin, W., Pfeffer, A., Sah, A., and Staelin, C. (1994). An economic paradigm for query processing and data migration in Mariposa . in Proc. of 3rd International Conference on Parallel and Distributed Information Systems (PDIS '94), Austin, TX, September.

Digital Library

[19]

Sherwani, J., Ali, N., Lotia, N., Hayat, Z., and Buyya, R. (2004). Libra: a computational economy-based job scheduling system for clusters, Software: Practice and Experience, 34(6): 573—590 .

Digital Library

[20]

Sulistio, A., Poduval, G., Buyya, R., and Tham, C.-K. (2005). Constructing a grid simulation with differentiated network service using GridSim, in Proc. of 6th International Conference on Internet Computing (ICOMP 2005), Las Vegas, NV, June.

[21]

Sun Microsystems (2002). Sun ONE Grid Engine, Administration and User's Guide, Sun Microsystems, October.

[22]

Supercluster Research and Development Group ( 2004). Maui Scheduler Version 3.2 Administrator's Guide, Supercluster Research and Development Group . {Online}. Available: http://www.supercluster.org/mauidocs/mauiadmin.shtml

[23]

University of Wisconsin-Madison (2004). Condor Version 6.7.1 Manual, University of Wisconsin-Madison . {Online}. Available: http://www.cs.wisc.edu/condor/manual/v6.7

[24]

Waldspurger, C.A., Hogg, T., Huberman, B.A., Kephart, J.O., and Stornetta, W.S. (1992). Spawn: A distributed computational economy, IEEE Trans. Software Eng., 18(2): 103— 117 .

Digital Library

Cited By

(2019)A dynamic and QoS-effective resource management systemInternational Journal of High Performance Computing and Networking10.5555/3337645.333764713:3(261-282)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3337645.3337647
Kianfar KMoslehi GYahyapour R(2015)A novel metaheuristic algorithm and utility function for QoS based scheduling in user-centric grid systemsThe Journal of Supercomputing10.1007/s11227-014-1358-871:3(1143-1162)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11227-014-1358-8
Carvalho DSouza LBarbastefano RFrança F(2015)Stochastic Product-MixJournal of Grid Computing10.1007/s10723-015-9325-z13:2(293-304)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1007/s10723-015-9325-z
Show More Cited By

Index Terms

Recommendations

A taxonomy of market-based resource management systems for utility-driven cluster computing

In utility-driven cluster computing, cluster Resource Management Systems (RMSs) need to know the specific needs of different users in order to allocate resources according to their needs. This in turn is vital to achieve service-oriented Grid computing ...
Autonomic metered pricing for a utility computing service

An increasing number of providers are offering utility computing services which require users to pay only when they use them. Most of these providers currently charge users for metered usage based on fixed prices. In this paper, we analyze the pros and ...
Self-adaptive resource management for large-scale shared clusters

In a shared cluster, each application runs on a subset of nodes and these subsets can overlap with one another. Resource management in such a cluster should adaptively change the application placement and workload assignment to satisfy the dynamic ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image International Journal of High Performance Computing Applications

International Journal of High Performance Computing Applications Volume 21, Issue 4

November 2007

111 pages

ISSN:1094-3420

Issue’s Table of Contents

Publisher

Sage Publications, Inc.

United States

Publication History

Published: 01 November 2007

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

(2019)A dynamic and QoS-effective resource management systemInternational Journal of High Performance Computing and Networking10.5555/3337645.333764713:3(261-282)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.5555/3337645.3337647
Kianfar KMoslehi GYahyapour R(2015)A novel metaheuristic algorithm and utility function for QoS based scheduling in user-centric grid systemsThe Journal of Supercomputing10.1007/s11227-014-1358-871:3(1143-1162)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11227-014-1358-8
Carvalho DSouza LBarbastefano RFrança F(2015)Stochastic Product-MixJournal of Grid Computing10.1007/s10723-015-9325-z13:2(293-304)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1007/s10723-015-9325-z
Chana IKaur T(2014)Resource Scheduling Techniques in Utility ComputingInternational Journal of Systems and Service-Oriented Engineering10.4018/ijssoe.20140401044:2(44-65)Online publication date: 1-Apr-2014
https://dl.acm.org/doi/10.4018/ijssoe.2014040104
Hussain HMalik SHameed AKhan SBickler GMin-Allah NQureshi MZhang LYongji WGhani NKolodziej JZomaya AXu CBalaji PVishnu APinel FPecero JKliazovich DBouvry PLi HWang LChen DRayes A(2013)A survey on resource allocation in high performance distributed computing systemsParallel Computing10.1016/j.parco.2013.09.00939:11(709-736)Online publication date: 1-Nov-2013
https://dl.acm.org/doi/10.1016/j.parco.2013.09.009
Costache SParlavantzas NMorin CKortas S(2013)On the use of a proportional-share market for application SLO support in cloudsProceedings of the 19th international conference on Parallel Processing10.1007/978-3-642-40047-6_35(341-352)Online publication date: 26-Aug-2013
https://dl.acm.org/doi/10.1007/978-3-642-40047-6_35
Miriam DEaswarakumar K(2012)A novel approach for QoS guided metascheduler for hypercubic P2P grid systemInternational Journal of Innovative Computing and Applications10.1504/IJICA.2012.0457054:1(43-51)Online publication date: 1-Mar-2012
https://dl.acm.org/doi/10.1504/IJICA.2012.045705
Miriam DEaswarakumar K(2012)SPA-based task scheduling for hypercubic P2P grid systemsInternational Journal of Communication Networks and Distributed Systems10.1504/IJCNDS.2012.0478999:1/2(117-139)Online publication date: 1-Jul-2012
https://dl.acm.org/doi/10.1504/IJCNDS.2012.047899
Xue ZDong XHu LLi J(2012)A performance and energy optimization mechanism for cooperation-oriented multiple server clustersFuture Generation Computer Systems10.1016/j.future.2011.04.02128:5(801-810)Online publication date: 1-May-2012
https://dl.acm.org/doi/10.1016/j.future.2011.04.021
Caramia MGiordani S(2011)An Economic Model for Resource Allocation in Grid ComputingOperations Research10.1287/opre.1100.090859:4(956-972)Online publication date: 1-Jul-2011
https://dl.acm.org/doi/10.1287/opre.1100.0908
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents