[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Starship DAG Race Condition #112

Open
fritz-astronomer opened this issue Nov 7, 2024 · 1 comment
Open

[BUG] Starship DAG Race Condition #112

fritz-astronomer opened this issue Nov 7, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@fritz-astronomer
Copy link
Contributor

Source: N/A
Destination: Astro
Airflow Version: N/A
Starship Version: N/A

Additional context
Infrequently, it was noticed that the Starship DAG would

  • Pause a DAG for migration in the source
  • Migrate the data (we should check that it waits for all DAG Runs/TIs to complete?)
  • Unpause the DAG in the target
  • (theory) Airflow would not have seen the new records and would schedule some DAG runs, causing additional (and problematic) past runs to occur

Thread

@fritz-astronomer fritz-astronomer added the bug Something isn't working label Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants
@fritz-astronomer and others