8000 Support hybrid_parallel_topo_order for auto parallel Llama by From00 · Pull Request #8011 · PaddlePaddle/PaddleNLP · GitHub

More Web Proxy on the site http://driver.im/

Support hybrid_parallel_topo_order for auto parallel Llama#8011

Merged

wawltor merged 11 commits intoPaddlePaddle:developfrom

From00:support-hybrid-parallel-topo-order-for-auto-parallel-llama

Mar 8, 2024

Commits on Feb 23, 2024

Support hybrid_parallel_topo_order for auto parallel Llama
From00
committed

Commits on Feb 26, 2024

Set order in hybrid_configs
From00
committed

Commits on Feb 27, 2024

Update get_mesh_with_dim
From00
committed

Commits on Mar 1, 2024

Commits on Mar 4, 2024

Merge branch 'develop' of https://github.com/PaddlePaddle/PaddleNLP into support-hybrid-parallel-topo-order-for-auto-parallel-llama
From00
committed

Commits on Mar 5, 2024

Update loss
From00
committed
Update loss
From00
committed

Commits on Mar 7, 2024

0