8000 Estimate memory usage · Issue #20 · microbiomedata/metaAssembly · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Estimate memory usage #20
Open
Open
@mflynn-lanl

Description

@mflynn-lanl

Assembly workflows can fail due to insufficient memory requested. One solution is to increase the amount of memory requested in the runtime attribute to accommodate all samples. However, memory usage by the assembly workflow can vary depending on the sample. Requesting a lot of memory means some jobs will request more than is needed and so fewer jobs can run at the same time. Brian Foster has a python script that can estimate memory usage based on the sample. We will add this to our Assembly workflow to adjust memory requested to better reflect how much is needed.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0