8000 Ensure culling changes layer names by fjetter · Pull Request #11903 · dask/dask · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Ensure culling changes layer names #11903

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 24, 2025

Conversation

fjetter
Copy link
Member
@fjetter fjetter commented Apr 24, 2025

This is pretty much an internal thing but the way HLGs are performing culling is dangerous and makes working with the API more difficult than it has to.

Culling does mutate layers but the internal tracking does not change the layer name to reflect this. Merging culled layers with HighlevelGraph.merge can therefore produce corrupted graphs.

I stumbled over this while fixing #11901

Copy link
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

      9 files  ±0        9 suites  ±0   3h 24m 2s ⏱️ + 6m 4s
 18 012 tests +1   16 798 ✅ + 1   1 214 💤 ±0  0 ❌ ±0 
161 182 runs  +9  149 077 ✅ +11  12 105 💤  - 2  0 ❌ ±0 

Results for commit 6c84cac. ± Comparison against base commit 3a81072.

@fjetter fjetter merged commit c68e71d into dask:main Apr 24, 2025
23 of 24 checks passed
@fjetter fjetter deleted the ensure_culling_changes_layers branch April 24, 2025 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant
0