8000 collective-communication · GitHub Topics · GitHub

More Web Proxy on the site http://driver.im/

#

collective-communication

Here is 1 public repository matching this topic...

hkproj / pytorch-transformer-distributed

Distributed training (multi-node) of a Transformer model

machine-learning tutorial deep-learning pytorch data-parallelism model-parallelism distributed-training gradient-accumulation distributed-data-parallel collective-communication

Updated Apr 10, 2024
Python

Improve this page

Add a description, image, and links to the collective-communication topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the collective-communication topic, visit your repo's landing page and select "manage topics."

0