Workflow Manager Technology Down Select for Demonstrator · Issue #58 · casangi/RADPS · GitHub

8000 Workflow Manager Technology Down Select for Demonstrator · Issue #58 · casangi/RADPS · GitHub

More Web Proxy on the site http://driver.im/

Workflow Manager Technology Down Select for Demonstrator #58

Open

Open

Workflow Manager Technology Down Select for Demonstrator#58

Task

Labels

ADRArchitecture

Milestone

Item 03: Walking Skeleton with data processing

Decision Required:

Select between Airflow and Prefect, and determine whether Dask should be included in the ALMA demonstrator.

Evaluation Criteria:

Performance
- Prefect Scheduler overhead testing of Prefect #36, Database overhead testing of Prefect #38
- Airflow Database overhead testing of Airflow #39
Developer experience
Support for checkpointing, rollback, and failure recovery
- Prefect Implement checkpointing, rollback recovery and failure detection in the Prefect workflow #30
- Airflow Implement checkpointing and rollback recovery in the Airflow workflow. #57
Ease of implementing "context like" functionality
- Prefect Develop a consistent Context mechanism for the the Prefect workflow #28
- Airflow Improve Airflow workflow #53
- Alternative context Investigate alternative Context design options #47
Additional relevant capabilities ...

Deliverable:

A concise wiki page documenting the decision and the rationale behind it.

Metadata

Assignees

No one assigned

Labels

ADRArchitecture

Type

Projects

No projects

Milestone

Item 03: Walking Skeleton with data processingNo due date

Relationships

None yet

Development

No branches or pull requests

0