8000 JSON bugfixes by lnkuiper · Pull Request #16729 · duckdb/duckdb · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

JSON bugfixes #16729

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Mar 20, 2025
Merged

JSON bugfixes #16729

merged 7 commits into from
Mar 20, 2025

Conversation

lnkuiper
Copy link
Contributor

Fixes:

All of which are JSON-related. I am targeting main, as these bugs aren't critical, and the JSON reader has gone through large changes on main, so fixing them there saves the effort of fixing them twice.

I've also fixed #16572 in this PR. The issue was caused by DuckDB preventing breadth-first plan evaluation to avoid using more memory than necessary. However, there is no risk of running out of memory when all of the children of a UNION ALL don't contain any Sink operators. By checking if this is the case, we can allow more parallelism for UNION ALL.

I have tested that this works with test/sql/parallelism/intraquery/depth_first_evaluation.test_slow locally (so this doesn't break the desired behavior when there are Sink operators), but this test is disabled because it was causing issues in CI.

@duckdb-draftbot duckdb-draftbot marked this pull request as draft March 20, 2025 10:03
@lnkuiper lnkuiper marked this pull request as ready for review March 20, 2025 10:04
@Mytherin Mytherin merged commit df40825 into duckdb:main Mar 20, 2025
50 checks passed
@Mytherin
Copy link
Collaborator

Thanks!

@lnkuiper lnkuiper deleted the bugfixes_json branch April 14, 2025 09:10
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request May 15, 2025
JSON bugfixes (duckdb/duckdb#16729)
Call Notify External Repositories from Invoke CI (duckdb/duckdb#16747)
shell: make -bail work for more errors (duckdb/duckdb#16594)
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request May 15, 2025
JSON bugfixes (duckdb/duckdb#16729)
Call Notify External Repositories from Invoke CI (duckdb/duckdb#16747)
shell: make -bail work for more errors (duckdb/duckdb#16594)
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request May 16, 2025
JSON bugfixes (duckdb/duckdb#16729)
Call Notify External Repositories from Invoke CI (duckdb/duckdb#16747)
shell: make -bail work for more errors (duckdb/duckdb#16594)
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request May 16, 2025
JSON bugfixes (duckdb/duckdb#16729)
Call Notify External Repositories from Invoke CI (duckdb/duckdb#16747)
shell: make -bail work for more errors (duckdb/duckdb#16594)
krlmlr added a commit to duckdb/duckdb-r that referenced this pull request May 17, 2025
JSON bugfixes (duckdb/duckdb#16729)
Call Notify External Repositories from Invoke CI (duckdb/duckdb#16747)
shell: make -bail work for more errors (duckdb/duckdb#16594)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Performance issue: No multi-threading unless I partition and union manually
2 participants
0