8000 [Upstream Triton] Handle user-specified triton.set_allocator function · Issue #155584 · pytorch/pytorch · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[Upstream Triton] Handle user-specified triton.set_allocator function #155584
Open
@davidberard98

Description

@davidberard98

🚀 The feature, motivation and pitch

Inductor needs to set triton.set_allocator when it is used for inductor-generated TMA matmuls.

But this may conflict with a user-specified allocator.

We need some API for specifying the behavior here - or at least behavior that errors out in bad scenarios

Alternatives

No response

Additional context

No response

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @chenyang78 @kadeng @muchulee8 @amjames @chauhang @aakhundov @bertmaher @int3 @nmacchioni @embg @peterbell10

Metadata

Metadata

Assignees

Labels

module: inductoroncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleupstream tritonUpstream Triton Issue

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0