Github Actions style data pipline execution engine.
Terminology:
- Flow: a single executable instance of a pipeline
- Operator: defines a reusable processing task
- Pipeline: defines the sequence of operators (tasks) to be performed.
- Step: a specific instance of an operator, configured and executed as part of a flow.
- Tenant: a permission boundary for access to resources