CUTLASS 3.6.0 #2013

hwu36 · 2024-12-25T22:19:24Z

hwu36
Dec 25, 2024
Maintainer

Hopper structured sparse GEMM.
- FP16
- FP8
- INT8
- TF32
A refactor to the CUTLASS 3.x convolution kernel::ConvUniversal API to bring it in line with gemm::GemmUniversal. Now the 3.x convolution API is no longer considered as a beta API.
An improved mixed input GEMM and a lookup table implementation for INT4xFP8 scale-only mode.
EVT nodes for Top-K selection and softmax and GEMM example using those.
Programmatic Dependent Launch (PDL) that leverages a new Hopper feature to speedup two back-to-back kernels, and its corresponding documentations.
A new debugging tool, synclog, for dumping out all synchronization events from within a kernel to a file. Please see synclog documentation for details.
A new TMA-enabled epilogue for grouped GEMM that brings significant performance improvement, as well as its EVT support.
A SIMT-enabled pointer-array epilogue.
A new Ping-Pong kernel schedule for Grouped GEMM and some other optimizations.
A new instantiation strategy for CUTLASS profiler kernels along with improved documentation for instantiation level in CUTLASS profiler.
A new hardware support for comparisons and computations of cutlass::bfloat16_t
Fixed use of isnan on Windows for half_t.

This discussion was created from the release CUTLASS 3.6.0.

8000

itanasic · 2024-12-27T03:04:19Z

@hwu36 most links in this post seem to be broken. At least the programmatic dependent launch and synclog ones are.

1 reply

thank you. i fixed the links. seems github changed the behavior of discussion board.