poster

Compiler-aided nd-range parallel-for implementations on CPU in hipSYCL

Authors:

Joachim Meyer,

Aksel Alpay,

Holger Fröning,

Vincent HeuvelineAuthors Info & Claims

IWOCL '22: Proceedings of the 10th International Workshop on OpenCL

Article No.: 28, Pages 1 - 3

https://doi.org/10.1145/3529538.3530216

Published: 10 May 2022 Publication History

Get Access

Abstract

With heterogeneous programming continuously on the rise, performance portability is still to be improved. SYCL provides the nd-range parallel-for paradigm for writing data-parallel kernels. This model allows barriers for group-local synchronization, similar to CUDA and OpenCL kernels. GPUs provide efficient means to model this, but on CPUs the necessary forward-progress guarantees require the use of many (lightweight) threads in library-only SYCL implementations, rendering the nd-range parallel-for unacceptably inefficient. By adopting two compiler-based approaches solving this, the present work improves the performance of the nd-range parallel-for in hipSYCL for CPUs by up to multiple orders of magnitude on various CPU architectures. The two alternatives are compared with regard to their functional correctness and performance. By upstreaming one of the variants, hipSYCL is the first SYCL implementation to provide a well performing nd-range parallel-for on CPU, without requiring an available OpenCL runtime.

Supplementary Material

a28-meyer-supplement (a28-meyer-supplement.pdf)

Poster

Download
410.47 KB

References

[1]

Aksel Alpay and Vincent Heuveline. 2020. SYCL beyond OpenCL: The Architecture, Current State and Future Direction of HipSYCL. In Proceedings of the International Workshop on OpenCL (Munich, Germany) (IWOCL ’20). Association for Computing Machinery, New York, NY, USA, Article 8, 1 pages. https://doi.org/10.1145/3388333.3388658

Digital Library

Google Scholar

[2]

Aksel Alpay and Vincent Heuveline. 2021. HipSYCL in 2021: Peculiarities, Unique Features and SYCL 2020. In International Workshop on OpenCL (Munich, Germany) (IWOCL’21). Association for Computing Machinery, New York, NY, USA, Article 18, 1 pages. https://doi.org/10.1145/3456669.3456691

Digital Library

Google Scholar

[3]

OpenMP Architecture Review Board. 2018. OpenMP Application Program Interface. OpenMP Architecture Review Board. Version 5.0 November 2018.

Google Scholar

[4]

Tom Deakin, Simon N McIntosh-Smith, Aksel Alpay, and Vincent Heuveline. 2021. Benchmarking and Extending SYCL Hierarchical Parallelism. In Workshop on Hierarchical Parallelism for Exascale Computing. IEEE Computer Society, United States, 10–19.

Google Scholar

[5]

Tom Deakin, James Price, Matt Martineau, and Simon McIntosh-Smith. 2016. GPU-STREAM v2.0: Benchmarking the Achievable Memory Bandwidth of Many-Core Processors Across Diverse Parallel Programming Models. In High Performance Computing, Michela Taufer, Bernd Mohr, and Julian M. Kunkel (Eds.). Springer International Publishing, Cham, 489–507.

Google Scholar

[6]

The Khronos®OpenCL Working Group. 2021. The OpenCL™ Specification. Khronos® Group. Version 3.0.8, retrieved on 19.08.21 from https://www.khronos.org/registry/OpenCL/specs/3.0-unified/pdf/OpenCL_API.pdf.

Google Scholar

[7]

Pekka Jääskeläinen, Carlos Sánchez de La Lama, Erik Schnetter, Kalle Raiskila, Jarmo Takala, and Heikki Berg. 2015. pocl: A performance-portable OpenCL implementation. International Journal of Parallel Programming 43, 5(2015), 752–785.

Digital Library

Google Scholar

[8]

Zheming Jin. 2021. HeCBench. Version ba8310c1, https://github.com/zjin-lcf/HeCBench, last accessed on 07.11.21.

Google Scholar

[9]

Pekka O. Jäskeläinen, Carlos S. de La Lama, Pablo Huerta, and Jarmo H. Takala. 2010. OpenCL-based design methodology for application-specific processors. In 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation. IEEE, Samos, Greece, 223–230. https://doi.org/10.1109/ICSAMOS.2010.5642061

Crossref

Google Scholar

[10]

David Kaeli, Perhaad Mistry, Dana Schaa, and Dong Ping Zhang. 2015. Chapter 8 - Dissecting OpenCL on a heterogeneous system. In Heterogeneous Computing with OpenCL 2.0, David Kaeli, Perhaad Mistry, Dana Schaa, and Dong Ping Zhang (Eds.). Morgan Kaufmann, Boston, 187–212. https://doi.org/10.1016/B978-0-12-801414-1.00008-9

Crossref

Google Scholar

[11]

Ralf Karrenberg and Sebastian Hack. 2012. Improving Performance of OpenCL on CPUs. In Compiler Construction, Michael O’Boyle (Ed.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1–20.

Google Scholar

[12]

Sohan Lal, Aksel Alpay, Philip Salzmann, Biagio Cosenza, Nicolai Stawinoga, Peter Thoman, Thomas Fahringer, and Vincent Heuveline. 2020. SYCL-Bench: A Versatile Single-Source Benchmark Suite for Heterogeneous Computing. In Proceedings of the International Workshop on OpenCL (Munich, Germany) (IWOCL ’20). Association for Computing Machinery, New York, NY, USA, Article 10, 1 pages. https://doi.org/10.1145/3388333.3388669

Digital Library

Google Scholar

[13]

Julian Rosemann, Simon Moll, and Sebastian Hack. 2021. An Abstract Interpretation for SPMD Divergence on Reducible Control Flow Graphs. Proc. ACM Program. Lang. 5, POPL, Article 31 (Jan. 2021), 31 pages. https://doi.org/10.1145/3434312

Digital Library

Google Scholar

Cited By

View all

Breyer MVan Craen APflüger D(2023)Performance Evolution of Different SYCL Implementations based on the Parallel Least Squares Support Vector Machine LibraryProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585369(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585369
Alpay AHeuveline V(2023)One Pass to Bind Them: The First Single-Pass SYCL Compiler with Unified Code Representation Across BackendsProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585351(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585351
Meyer JAlpay AHack SFröning HHeuveline V(2023)Implementation Techniques for SPMD Kernels on CPUsProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585342(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585342
Show More Cited By

Index Terms

Compiler-aided nd-range parallel-for implementations on CPU in hipSYCL
1. Computing methodologies
  1. Parallel computing methodologies
    1. Parallel programming languages
2. Software and its engineering
  1. Software notations and tools
    1. Compilers
    2. General programming languages
      1. Language types
        Parallel programming languages

Index terms have been assigned to the content through auto-classification.

Recommendations

A Comparison of SYCL, OpenCL, CUDA, and OpenMP for Massively Parallel Support Vector Machine Classification on Multi-Vendor Hardware
IWOCL '22: Proceedings of the 10th International Workshop on OpenCL

In scientific computing and Artificial Intelligence (AI), which both rely on massively parallel tasks, frameworks like the Compute Unified Device Architecture (CUDA) and the Open Computing Language (OpenCL) are widely used to harvest the computational ...
Implementation Techniques for SPMD Kernels on CPUs
IWOCL '23: Proceedings of the 2023 International Workshop on OpenCL

More and more frameworks and simulations are developed using heterogeneous programming models such as OpenCL, SYCL, CUDA, or HIP. A significant hurdle to mapping these models to CPUs in a performance-portable manner is that implementing work-group ...
Performance Evolution of Different SYCL Implementations based on the Parallel Least Squares Support Vector Machine Library
IWOCL '23: Proceedings of the 2023 International Workshop on OpenCL

In machine learning and scientific computing, some of the biggest challenges are efficient and performant portable computing. With our Parallel Least Squares Support Vector Machine (PLSSVM) library, we have not only developed an unrivaled Support ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IWOCL '22: Proceedings of the 10th International Workshop on OpenCL

May 2022

123 pages

ISBN:9781450396585

DOI:10.1145/3529538

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 May 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

IWOCL'22

IWOCL'22: International Workshop on OpenCL

May 10 - 12, 2022

Bristol, United Kingdom, United Kingdom

Acceptance Rates

Overall Acceptance Rate 84 of 152 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
72
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Breyer MVan Craen APflüger D(2023)Performance Evolution of Different SYCL Implementations based on the Parallel Least Squares Support Vector Machine LibraryProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585369(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585369
Alpay AHeuveline V(2023)One Pass to Bind Them: The First Single-Pass SYCL Compiler with Unified Code Representation Across BackendsProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585351(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585351
Meyer JAlpay AHack SFröning HHeuveline V(2023)Implementation Techniques for SPMD Kernels on CPUsProceedings of the 2023 International Workshop on OpenCL10.1145/3585341.3585342(1-12)Online publication date: 18-Apr-2023
https://dl.acm.org/doi/10.1145/3585341.3585342
Ghiglio PDolinsky UGoli MNarasimhan K(2023)Improving performance of SYCL applications on CPU architectures using LLVM‐directed compilation flowConcurrency and Computation: Practice and Experience10.1002/cpe.781035:27Online publication date: 30-May-2023
https://doi.org/10.1002/cpe.7810
Deakin TCownie JLin WMcIntosh-Smith S(2022)Heterogeneous Programming for the Homogeneous Majority2022 IEEE/ACM International Workshop on Performance, Portability and Productivity in HPC (P3HPC)10.1109/P3HPC56579.2022.00006(1-13)Online publication date: Nov-2022
https://doi.org/10.1109/P3HPC56579.2022.00006

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

A Comparison of SYCL, OpenCL, CUDA, and OpenMP for Massively Parallel Support Vector Machine Classification on Multi-Vendor Hardware

Implementation Techniques for SPMD Kernels on CPUs

Performance Evolution of Different SYCL Implementations based on the Parallel Least Squares Support Vector Machine Library

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations