8000 PP activation offloading · Issue #155490 · pytorch/pytorch · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
PP activation offloading #155490
New issue
New issue
Open
Open
PP activation offloading#155490
Assignees
H-Huang
Labels
module: pipeliningPipeline Parallelismoncall: distributedAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@H-Huang

Description

@H-Huang
H-Huang
opened on Jun 9, 2025

Add feature to PP to perform activation offloading (based on PipeOffload: https://arxiv.org/pdf/2503.01328).

related: #145511

cc @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k

Metadata

Metadata

Assignees

Labels

module: pipeliningPipeline Parallelismoncall: distributedAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions
    0