8000 Does end_on_device make sense? · Issue #213 · mlcommons/inference_policies · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Does end_on_device make sense? #213
Open
@DilipSequeira

Description

@DilipSequeira

The rationale for start_from_device is that submissions should not need to incur the overhead of transfer from system DRAM if there is a mechanism whereby network inputs can be delivered directly into accelerator memory.

Is end_on_device symmetric in this regard - e.g. submitters should not have to incur an overhead for transfer to system DRAM if the accelerator has the equivalent outbound capability?

@tjablin opinion?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0