8000 Commits · yzs981130/torchtitan · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Sep 13, 2024

update README to include new features and remove outdated msg
tianyu-l
committed

Commits on Sep 12, 2024

fix float8 after the HSDP PR (#575)
tianyu-l
authored

Commits on Sep 10, 2024

Commits on Sep 8, 2024

Commits on Sep 4, 2024

Removed unused dw tensor in Triton RMSNorm
Andrew Gu
committed

Commits on Aug 30, 2024

Commits on Aug 22, 2024

remove PP tracer
tianyu-l
committed

Commits on Aug 21, 2024

[MRG] relax the FP8 CUDA arch limitation to SM89 (#549)

leeeizhang
and
awgu
authored

Commits on Aug 20, 2024

remove compiled_rmsnorm
tianyu-l
committed
Updated `FSDP` -> `FSDPModule` in doc
Andrew Gu
committed

Commits on Aug 19, 2024

keep pp vs. non-pp split
tianyu-l
committed

Commits on Aug 16, 2024

Commits on Aug 15, 2024

remove old torch dependency in requirements.txt
tianyu-l
committed

Commits on Aug 14, 2024

Update fsdp.md (#519)
crcrpar
authored

Commits on Aug 13, 2024

Throw warning if users are using old pytorch version that not including DTensor strided sharding (#507)
XilunWu
authored

Commits on Aug 12, 2024

Commits on Aug 9, 2024

Commits on Aug 8, 2024

Commits on Aug 7, 2024

Commits on Aug 6, 2024

Add warning to compile rmsnorm (#505)
wanchaol
authored

Commits on Aug 5, 2024

[fix] float8 should be applied on all model_parts
tianyu-l
committed

0