8000 Example fruit_stand pipeline appends to output files · Issue #24 · fjukstad/walrus · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Example fruit_stand pipeline appends to output files #24
Open
@fjukstad

Description

@fjukstad

While the fruit_stand example pipeline is correct, the pipeline appends data in the filter step and might confuse users since the final output will change after re-running the pipeline multiple times. A solution is to remove all previous results or highlight the fact that the final result will update since each pipeline run will append to the previous results. The troublesome line:

for fruit in apple orange banana; do grep $fruit /walrus/input/set1.txt | awk '{print $2}' >> /walrus/filter/$fruit; done

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0