8000 Fix autoloading required extension for data_path by carlopi · Pull Request #14 · duckdb/ducklake · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Fix autoloading required extension for data_path #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
May 26, 2025

Conversation

carlopi
Copy link
Contributor
@carlopi carlopi commented May 26, 2025
ATTACH 'ducklake:autoload_problem.ducklake' (DATA_PATH 's3://some-bucket/');

will, without this PR, do not autoload httpfs, and eventually use the folder s3://some-bucket using the default folder when httpfs is missing OR remote bucket when httpfs is present.

This PR makes so that in either case an initialized DuckLake has to be usable, possible paths are:

  • extension already present (or no extension needed), nop
  • required extension is autoinstalled and autoloaded
  • user is informed of which extension is needed, and ducklake ATTACH fails

As a consequence of this, secrets are also loaded, but there is no actual test the path is actually reachable (say networking or mismatched secrets). For that an insert or scan is actually needed (keeping same behaviour as now, so initialize perform no network request to data_path).

Test shows what are the possibilities, to be able to run the test (but for the last line), the following can be used

GEN=ninja make
LOCAL_EXTENSION_REPO='build/release/repository' ./build/release/test/unittest --test-dir . test/sql/autoloading/autoload_data_path.test

To manage also the last like, httpfs extension is needed to be built (but not linked) together with ducklake.

carlopi added 3 commits May 26, 2025 10:28
This currently requires:
`httpfs` extension to be build together with `ducklake`, and then:
LOCAL_EXTENSION_REPO='build/release/repository' ./build/release/test/unittest --test-dir . test/sql/autoloading/autoload_data_path.test
@Mytherin Mytherin merged commit 8a363bb into duckdb:main May 26, 2025
@Mytherin
Copy link
Contributor

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants
0