Article

Exploring the Performance Fluctuations of HPC Workloads on Clouds

Authors:

Yaakoub El-Khamra,

Hyunjoo Kim,

Shantenu Jha,

Manish ParasharAuthors Info & Claims

CLOUDCOM '10: Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science

Pages 383 - 387

https://doi.org/10.1109/CloudCom.2010.84

Published: 30 November 2010 Publication History

Publisher Site

Abstract

Clouds enable novel execution modes often supported by advanced capabilities such as autonomic schedulers. These capabilities are predicated upon an accurate estimation and calculation of runtimes on a given infrastructure. Using a well understood high-performance computing workload, we find strong fluctuations from the mean performance on EC2 and Eucalyptus-based cloud systems. Our analysis eliminates variations in IO and computational times as possible causes, we find that variations in communication times account for the bulk of the experiment-to-experiment fluctuations of the performance.

Cited By

View all

Zhang XZheng XWang ZYang HShen YLong XLarus JCeze LStrauss K(2020)High-density Multi-tenant Bare-metal CloudProceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3373376.3378507(483-495)Online publication date: 9-Mar-2020
https://dl.acm.org/doi/10.1145/3373376.3378507
Gan YZhang YHu KCheng DHe YPancholi MDelimitrou CBahar IHerlihy MWitchel ELebeck A(2019)SeerProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304004(19-33)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304004
Amaral MPolo JCarrera DSeelam SSteinder MMohr BRaghavan P(2017)Topology-aware GPU scheduling for learning workloads in cloud environmentsProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3126908.3126933(1-12)Online publication date: 12-Nov-2017
https://dl.acm.org/doi/10.1145/3126908.3126933
Show More Cited By

Exploring the Performance Fluctuations of HPC Workloads on Clouds
1. Computer systems organization

Recommendations

Skyway: A Seamless Solution for Bursting Workloads from On-Premises HPC Clusters to Commercial Clouds
PEARC '21: Practice and Experience in Advanced Research Computing 2021: Evolution Across All Dimensions

Interest in cloud computing within the High Performance Computing (HPC) community continues to grow, but barriers to wide-spread adoption remain over concerns of cost, support of low-latency network applications, and data management. Despite these ...
Monitoring-based auto-scalability across hybrid clouds
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Cloud computing is a relatively new type of Internet-based computing that becomes more and more popular. Using methods like virtualization, adopting architectures based on microservices, automation of building and deployment processes, Cloud could ...
Case study for running HPC applications in public clouds
HPDC '10: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Cloud computing is emerging as an alternative computing platform to bridge the gap between scientists' growing computational demands and their computing capabilities. A scientist who wants to run HPC applications can obtain massive computing resources '...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CLOUDCOM '10: Proceedings of the 2010 IEEE Second International Conference on Cloud Computing Technology and Science

November 2010

801 pages

ISBN:9780769543024

Publisher

IEEE Computer Society

United States

Publication History

Published: 30 November 2010

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang XZheng XWang ZYang HShen YLong XLarus JCeze LStrauss K(2020)High-density Multi-tenant Bare-metal CloudProceedings of the Twenty-Fifth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3373376.3378507(483-495)Online publication date: 9-Mar-2020
https://dl.acm.org/doi/10.1145/3373376.3378507
Gan YZhang YHu KCheng DHe YPancholi MDelimitrou CBahar IHerlihy MWitchel ELebeck A(2019)SeerProceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3297858.3304004(19-33)Online publication date: 4-Apr-2019
https://dl.acm.org/doi/10.1145/3297858.3304004
Amaral MPolo JCarrera DSeelam SSteinder MMohr BRaghavan P(2017)Topology-aware GPU scheduling for learning workloads in cloud environmentsProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3126908.3126933(1-12)Online publication date: 12-Nov-2017
https://dl.acm.org/doi/10.1145/3126908.3126933
Delimitrou CKozyrakis C(2017)BoltACM SIGARCH Computer Architecture News10.1145/3093337.303770345:1(599-613)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3093337.3037703
Delimitrou CKozyrakis C(2017)BoltACM SIGPLAN Notices10.1145/3093336.303770352:4(599-613)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3093336.3037703
Wang CUrgaonkar BNasiriani NKesidis G(2017)Using Burstable Instances in the Public CloudProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/30844481:1(1-28)Online publication date: 13-Jun-2017
https://dl.acm.org/doi/10.1145/3084448
Delimitrou CKozyrakis CChen YTemam OCarter J(2017)BoltProceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3037697.3037703(599-613)Online publication date: 4-Apr-2017
https://dl.acm.org/doi/10.1145/3037697.3037703
Zant BGagnaire M(2015)Towards a unified customer aware figure of merit for CSP selectionJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-015-0049-14:1(1-23)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1186/s13677-015-0049-1
Blagodurov SFedorova AVinnik EDwyer THermenier FKern JVetter J(2015)Multi-objective job placement in clustersProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/2807591.2807636(1-12)Online publication date: 15-Nov-2015
https://dl.acm.org/doi/10.1145/2807591.2807636
Petri lZou MZamani ADiaz-Montes JRana OParashar MBalaji PXu C(2015)Integrating software defined networks within a cloud federationProceedings of the 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing10.1109/CCGrid.2015.11(179-188)Online publication date: 4-May-2015
https://dl.acm.org/doi/10.1109/CCGrid.2015.11
Show More Cited By

Abstract

Cited By

Recommendations

Skyway: A Seamless Solution for Bursting Workloads from On-Premises HPC Clusters to Commercial Clouds

Monitoring-based auto-scalability across hybrid clouds

Case study for running HPC applications in public clouds

Comments

Information

Published In

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations