List view
Identify workflow management and resource management reliability metrics and describe how these metrics could be measured.
No due date•0/3 issues closedObtain initial performance efficiency measurements by executing the walking skeleton with data processing on premises (Kubernetes) and in the cloud (AWS).
No due dateIncorporate data processing and domain application execution into the walking skeleton.
No due date•0/3 issues closedCreate a walking skeleton that demonstrates the feasibility of constructing and executing radio astronomy workflows without processing data.
No due date•17/26 issues closedFor this item, the system can be a single workstation or virtual machine using, for example, a docker image for the workflow management subsystem and a docker image for the resource manager subsystem. The objective is to evaluate workflow concepts in terms of one or more technology candidates (e.g., Airflow, Prefect, etc.). For a given technology candidate: 1. Demonstrate how the workflow, stage, and single threaded task concepts map to the provided example [workflow](https://nrao.slack.com/docs/T5G3SA6DV/F0889MYEECE?focus_section_id=temp:C:TFE8a0c5d5549da42ed8dd2c68a8) and [stages](https://nrao.slack.com/docs/T5G3SA6DV/F0889MYEECE?focus_section_id=temp:C:TFE045e8fcfac5d441db893be58d). 2. Demonstrate how a workflow can be executed [automatically](https://nrao.sharepoint.com/:w:/s/NRAOngVLA/Ea76I3WnTfREkFLmEjkdgD4BdcuNej2GqATIHRlzq7K2HA?e=Y2uno8&nav=eyJoIjoiMTExNzA1NTczMiJ9) and [interactively](https://nrao.sharepoint.com/:w:/s/NRAOngVLA/Ea76I3WnTfREkFLmEjkdgD4BdcuNej2GqATIHRlzq7K2HA?e=JmfBsT&nav=eyJoIjoiMTE5MjU1ODY2NSJ9). 3. Demonstrate the [context](https://pipe-docs.readthedocs.io/en/latest/notebooks/context.html) capability. 4. Demonstrate how a task is delegated to a [resource manager](https://nrao.sharepoint.com/:w:/s/DataManagementSoftware/EWDRJ0P2JOxCh0wNLMdlRXEB25UI_XLegaeVgQ-A0PKdRQ?e=FpjDF9&nav=eyJoIjoiMTkyNjU1Njk2NCJ9). The goal is to show how this works at the interface level. No “real” implementation is required. 5. Produce a document summarizing the results.
No due date•4/9 issues closed