[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3626203.3670537acmconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
research-article
Open access

Ten Years of the HPC Ecosystems Project - Transforming HPC in Africa for the past decade

Published: 17 July 2024 Publication History

Abstract

The Council for Scientific and Industrial Research (CSIR)'s National Integrated Cyberinfrastructure System (NICIS) plays a pivotal role in advancing two key initiatives that focus on developing cyberinfrastructure across the African continent: the Southern African Development Community (SADC) Cyberinfrastructure Framework, and the Square Kilometre Array (SKA) Partner Countries Big Data initiative. Within NICIS these initiatives are managed through the HPC Ecosystems Project, which has two primary objectives: distributing entry level High Performance Computing (HPC) systems by repurposing decommissioned tier-1 HPC systems, and cultivating a skilled HPC workforce across Africa. The first deployment of HPC systems under the project occurred in 2013, using repurposed hardware from the Texas Advanced Computing Center's decommissioned Ranger HPC system. These systems were allocated to bolster research capabilities at local research institutes in South Africa and within partner countries of the SKA project across Africa. A decade later, at the close of 2023, the HPC Ecosystems Project has deployed 35 HPC systems in 11 countries and delivered more than 30 formal HPC training workshops to over 700 participants, surpassing 21000 total participation hours. There is an active and growing virtual community exceeding 230 HPC practitioners globally. This paper provides a high-level overview of the first ten years of the project's lifespan; outlining the various approaches towards establishing sustainable cyberinfrastructure and HPC workforces in Africa. Included is a reflection on the challenges experienced, lessons learned, and progress made towards delivering cyberinfrastructure resources and HPC training to resource-constrained environments.

References

[1]
Abiona, O., Onime, C., Cozzini, S. and Hailemariam, S. Capacity building for HPC Infrastructure setup in Africa: The ICTP experience.
[2]
Amolo, G.O. 2018. The Growth of High-Performance Computing in Africa. Computing in Science and Engineering. 20, 3 (May 2018), 21–24.
[3]
Apostolos, K. and Alivisos, S. 2010. Internet-mediated communities of practice (IMCoPs): A meta-analysis of critical elements. Proceedings - 2nd International Conference on Intelligent Networking and Collaborative Systems, INCOS 2010. (2010), 1–7.
[4]
Cahill, K.J., Lathrop, S. and Gordon, S. 2017. ScienceDirect Building a Community of Practice to Prepare the HPC Workforce. 2017, (2017), 12–14.
[5]
Erich, S., Jack, D., Horst, S. and Martin, M. 2008. Top 500 list - Ranger – SunBlade x6420, Opteron Quad2Ghz,Infiniband.
[6]
Gordon, S.I., Demmel, J., Destefano, L. and Rivera, L. 2015. Extending access to HPC skills through a blended online course. ACM International Conference Proceeding Series. 2015-July, (Jul. 2015).
[7]
Hudak, R., Bitterman, D.E., Carey, T., Johnson, P., Franz, D., Brady, E. and Diwan, S. 2018. Open OnDemand: A web-based client portal for HPC centers. 43, (2018), 1–43.
[8]
Johnston, B. 2019. HPC Ecosystems Project: Facilitating advanced research computing in Africa. ACM International Conference Proceeding Series. (Jul. 2019).
[9]
Johnston, B., Timm, L., de Beste, E. and Hashatsi, M. 2024. Let's Get Our Heads Out of the Clouds: A scalable and sustainable approach to HPC Training Labs for Resource Constrained Environments and anyone else stuck in the Clouds. The Journal of Computational Science Education. 15, 1 (Mar. 2024), 64–71.
[10]
Jongerius, R. 2016. Exascale Computer System Design: The Square Kilometre Array. Technische Universiteit Eindhoven.
[11]
Katernyak, I., Loboda, V. and Kulya, M. 2018. eLearning within the Community of Practice for sustainable development. Higher Education, Skills and Work-based Learning. 8, 3 (Aug. 2018), 312–322.
[12]
Lang, C. 2015. Cultivating HPC in South Africa. HPCwire.
[13]
Michinov, N., Brunot, S., Le Bohec, O., Juhel, J. and Delaval, M. 2011. Procrastination, participation, and performance in online learning environments. (2011).
[14]
Motshegwa, T., Wright, C., Sithole, H., Ngolwe, C. and Morgan, A. 2018. Developing a Cyber-infrastructure for Enhancing Regional Collaboration on Education, Research, Science, Technology and Innovation. (2018).
[15]
Nkundwe Mwasaga, M., Apiola, M., Suhonen, J. and Joy, M. Integrating High Performance Computing into a Tanzanian IT Engineering Curriculum.
[16]
Ranger Supercomputer Begins New Life, Makes Global Journey to Africa - Research & Development World: https://www.rdworldonline.com/ranger-supercomputer-begins-new-life-makes-global-journey-to-africa/. Accessed: 2024-02-28.
[17]
Schulz, K.W., Baird, C.R., Brayford, D., Georgiou, Y., Gregory, A., Kurtzer, M., Pittsburgh, D.S., Center, S., Sterling, T., Sundararajan, N., Eric, D. and Hensbergen, V. 2016. Cluster Computing with OpenHPC. (Nov. 2016).
[18]
Shapopi, J., Limbo, A. and Backes, M. 2023. Namibia's first high performance computer. South African Computer Journal. 35, 1 (2023), 4–18.
[19]
Trader, T. 2014. NSF Petaflopper Skips Retirement for New Life in Africa. HPCwire.
[20]
Wenger, E. 2008. Communities of Practice: Learning as a Social System. (2008).

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
PEARC '24: Practice and Experience in Advanced Research Computing 2024: Human Powered Computing
July 2024
608 pages
ISBN:9798400704192
DOI:10.1145/3626203
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 July 2024

Check for updates

Author Tags

  1. Africa
  2. HPC Ecosystems Project
  3. Resource Constrained Environments
  4. Workforce Development

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

PEARC '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 133 of 202 submissions, 66%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 329
    Total Downloads
  • Downloads (Last 12 months)329
  • Downloads (Last 6 weeks)60
Reflects downloads up to 20 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media