8000 Commits · wegod/ColossalAI · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Feb 13, 2023

[zero1&2] only append parameters with gradients (#2681)
1SAA
authored
[gemini] add fake_release_chunk for keep-gathered chunk in the inference mode (#2671)
1SAA
authored

Commits on Feb 3, 2023

[polish] polish ColoTensor and its submodules (#2537)
1SAA
authored

Commits on Jan 31, 2023

Commits on Jan 30, 2023

[gemini] update the gpt example (#2527)
1SAA
authored

Commits on Jan 29, 2023

Commits on Jan 28, 2023

[gemini] update ddp strict mode (#2518)
1SAA
authored

Commits on Jan 20, 2023

[zero] add strict ddp mode (#2508)
1SAA
authored

Commits on Jan 18, 2023

[zero] add unit testings for hybrid parallelism (#2486)
1SAA
authored

Commits on Jan 15, 2023

[zero] add unit test for low-level zero init (#2474)
1SAA
authored

Commits on Jan 13, 2023

[zero] polish low level optimizer (#2473)
1SAA
authored

Commits on Jan 10, 2023

Commits on Jan 9, 2023

Commits on Jan 6, 2023

Commits on Jan 4, 2023

Commits on Jan 3, 2023

Commits on Dec 29, 2022

Commits on Dec 28, 2022

[diffusion] update readme (#2214)
1SAA
authored

Commits on Dec 26, 2022

Commits on Dec 20, 2022

[example] add zero1, zero2 example in GPT examples (#2146)
1SAA
authored

Commits on Dec 12, 2022

[optimizer] add div_scale for optimizers (#2117)
1SAA
authored

0