Open
Description
We defines the type primarily used in job clusters as a complex variable and manages its definition and distribution through DABs. However, we want to modify only certain variables of the complex variable based on the size or nature of the job, which is currently unsupported. As a result, they need to define each job cluster separately.
Their request is as follow. (override example of num_of_workers)
resources:
jobs:
aa:
...
job_clusters:
- job_cluster_key: default
new_cluster: ${var.legacy-multi-node-job}
num_workers: 1
bb: ...
job_clusters:
- job_cluster_key: default
new_cluster: ${var.legacy-multi-node-job}
num_workers: 7
... # many jobs with different num of workers