Releases: PeerDB-io/peerdb
Releases · PeerDB-io/peerdb
v0.30.4
What's Changed
- support pgvector types as float32 array by @serprex in #3061
- fix: improve S3 credential handling and chunk processing in ClickHouse sync by @iskakaushik in #3071
- ch: never use params by @serprex in #3073
- feat(ui): pull and show column mapping from source by @iamKunalGupta in #3074
- remove layer of indirection with AvroFile by @serprex in #3072
- feat(classifier): more errors by @iamKunalGupta in #3075
- mysql: update checkpoint in catalog once an hour while waiting for records by @serprex in #3070
- test(classifier): Postgres connection refused by @iamKunalGupta in #3077
- don't log failed queries by @serprex in #3078
- mysql: more accurate bean counting by @serprex in #3080
- chore(deps): update temporalio/ui docker tag to v2.38.3 by @renovate in #3081
- chore(deps): update docker/dockerfile docker tag to v1.17 by @renovate in #3082
- chore: update dependencies by @serprex in #3079
- TEMPORAL_CLIENT_CERT_PATH, TEMPORAL_CLIENT_KEY_PATH by @serprex in #3064
- use net.JoinHostPort by @serprex in #3091
- ch cleanup by @serprex in #3094
- introduce mirror versioning, put pgvector support behind version gate by @serprex in #3066
- remove Tembo by @serprex in #3096
- Remove custom column name regex by @Amogh-Bharadwaj in #3097
Full Changelog: v0.30.3...v0.30.4
Contributors
serprex, iskakaushik, and 3 other contributors
Assets 2
v0.30.3
What's Changed
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions in #3044 - ClickHouse: fix CDC for timestamp arrays by @ilidemi in #3041
- Fix up QValueInterval and TimeTZ by @ilidemi in #3048
- remove lib/pq/oid dependency by @serprex in #3049
- [clickhouse] refactor building queries for SyncRecords by @heavycrystal in #3050
- ParsePgArrayToStringSlice: map NULL to empty string by @serprex in #3051
- PG: Support more types as strings and string arrays by @ilidemi in #3040
- nit: more explicit return type on multirangeToTyped by @serprex in #3053
- handle flow-state-change during rename tables by @heavycrystal in #3046
- source connector: inject source schema for PEERDB_SOURCE_SCHEMA_AS_DESTINATION_COLUMN by @serprex in #3052
- chore(deps): update dockerfile dependencies by @renovate in #3057
- chore(deps): update github-actions dependencies by @renovate in #3058
- chore: update dependencies by @serprex in #3056
- chore(deps): update temporalio/ui docker tag to v2.38.0 by @renovate in #3059
- chore(classifier): log error post classification for tracking by @iamKunalGupta in #3062
Full Changelog: v0.30.2...v0.30.3
Contributors
serprex, renovate, and 3 other contributors
Assets 2
v0.30.2
What's Changed
- s3: rootCAs/tlsHost by @serprex in #3001
- ch: optimize escape by @serprex in #3008
- Minor fixes in type conversions by @ilidemi in #3009
- move type conversion related qvalue package to shared by @jgao54 in #3011
- ui: add ch root ca field back by @serprex in #3013
- move pg -> qvalue logic to shared for type conversion by @jgao54 in #3012
- s3: avro codec field by @serprex in #3015
- fix small perf regression by @jgao54 in #3017
- MySQL: Improve parallel snapshot by @Amogh-Bharadwaj in #3002
- feat(classifier): recovery canceling statement as connectivity by @iamKunalGupta in #3016
- ClickHouse: Maintain normalize metadata to prevent redundant sync steps by @Amogh-Bharadwaj in #2662
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions in #3021 - chore: update dependencies by @serprex in #3022
- move mysql qvalue logic to shared by @jgao54 in #3023
- chore(deps): update golang:1.24-alpine docker digest to 68932fa by @renovate in #3025
- chore(deps): update github-actions dependencies by @renovate in #3024
- ch: don't classify root cert field in ui as s3 field by @serprex in #3027
- chore(deps): update otel/opentelemetry-collector-contrib docker tag to v0.128.0 by @renovate in #3028
- chore(deps): update postgres:17-alpine docker digest to fbe2160 by @renovate in #3030
- ENV TZ=UTC by @serprex in #3029
- classify ConfigurationLimitExceeded by @heavycrystal in #3026
- ch: skip rename for null table engine resync by @serprex in #3014
- Support numeric arrays by @ilidemi in #3019
- Optimize setup flow for table addition by @Amogh-Bharadwaj in #2141
- handle flow-state-change during add tables by @heavycrystal in #3037
- change QValueTime/QValueTimeTZ to internally use time.Duration not time.Time by @serprex in #3036
- mysql: don't update gset on QueryEvent by @serprex in #3043
Full Changelog: v0.30.1...v0.30.2
Contributors
serprex, renovate, and 5 other contributors
Assets 2
v0.30.1
v0.30.1
This tag was signed with the committer’s verified signature.
afcb696
This commit was signed with the committer’s verified signature.
What's Changed
- slot info: don't poll for completed/terminated mirrors by @serprex in #2990
- [mysql] more logs and some changes in ctx handling by @heavycrystal in #2988
- implement backend for fetching type conversions by @jgao54 in #2989
- add frontend for fetching type conversion by @jgao54 in #2987
- ch: set alter_sync to 1 by @serprex in #2999
- [clickhouse] ch_s3_stage now drops as metadata instead of SyncFlowCleanup by @heavycrystal in #2995
- feat(classifier): deadline exceeded in peer create as connectivity by @iamKunalGupta in #3005
- ReplicatedMergeTree: no version parameter by @serprex in #3004
- s3: fix stats by @serprex in #3006
Full Changelog: v0.30.0...v0.30.1
Contributors
serprex, jgao54, and 2 other contributors
Assets 2
v0.30.0
v0.30.0
This tag was signed with the committer’s verified signature.
c34ead3
This commit was signed with the committer’s verified signature.
What's Changed
- node 24 by @serprex in #2953
- [resync] Fix bug where resync wasn't cleaning up any metadata state by @iskakaushik in #2954
- Remove sync resync & drop api by @serprex in #2960
- nexus: fix warnings by @serprex in #2961
- [clickhouse] all NormalizeErrors are NotifyMVOrView by @heavycrystal in #2959
- hamba/avro by @serprex in #2962
- replace custom avro schema building logic with hamba schema by @serprex in #2965
- classify mysql.ErrBadConn as EOF by @serprex in #2966
- mysql: classify 1236. new gauge: CommitLag by @serprex in #2969
- refactor: dedup maintenance error by @iamKunalGupta in #2971
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions in #2955 - Extend API test for resync by @Amogh-Bharadwaj in #2956
- Support numeric to string via destination_type in API by @jgao54 in #2964
- Test & fix mysql custom partitioning by @serprex in #2974
- mysql: also show qkind in error message by @serprex in #2976
- refactor(classifier): convert WalErrors to PgErrors and re-use existing switch by @iamKunalGupta in #2977
- convert numrows from int to int64 by @serprex in #2981
- Initial load chunking by @serprex in #2936
- zod/v4 by @serprex in #2983
- MySQL Mirror: set max execution time by @Amogh-Bharadwaj in #2958
- engines: ReplicatedReplacingMergeTree, ReplicatedMergeTree by @serprex in #2949
- make pg nullable schema changes less heuristical by @serprex in #2985
- Fix: resync while a resync mirror is in setup/initial load by @Amogh-Bharadwaj in #2972
New Contributors
Full Changelog: v0.29.0...v0.30.0
Contributors
serprex, iskakaushik, and 4 other contributors
Assets 2
v0.29.2
What's Changed
- Remove sync resync & drop api by @serprex in #2960
- nexus: fix warnings by @serprex in #2961
- [clickhouse] all NormalizeErrors are NotifyMVOrView by @heavycrystal in #2959
Full Changelog: v0.29.1...v0.29.2
Contributors
serprex and heavycrystal
Assets 2
v0.29.1
What's Changed
- node 24 by @serprex in #2953
- [resync] Fix bug where resync wasn't cleaning up any metadata state by @iskakaushik in #2954
Full Changelog: v0.29.0...v0.29.1
Contributors
-
-
serprex and iskakaushik
Assets 2
v0.29.0
v0.29.0
This tag was signed with the committer’s verified signature.
d75b7ca
This commit was signed with the committer’s verified signature.
What's Changed
- Update AWS global bundle SHA by @ilidemi in #2923
- Add API test for adding a table before a resync by @Amogh-Bharadwaj in #2918
- Classify missing table on PG by @Amogh-Bharadwaj in #2906
- mysql: support full range of time by @serprex in #2928
- Classify some mysql errors by @serprex in #2870
- feat(classifier): more nested query cases by @iamKunalGupta in #2921
- [mysql] general fixes by @heavycrystal in #2924
- fix(alerting): remove explicit flowName to prevent collision by @iamKunalGupta in #2937
- feat: upgrade
docker-compose.ymlstable image tags by @github-actions in #2903 - feat(classifier): aurora zero downtime patch should be recoverable by @iamKunalGupta in #2940
- Add a setting to skip certificate verification for MySQL by @ilidemi in #2942
- Migrate from pyroscope to pprof by @iskakaushik in #2941
- feat(wf-status): raise error if flow not found in catalog by @iamKunalGupta in #2939
- Logs tab in UI: fix extractFromCloneName by @Amogh-Bharadwaj in #2926
- Change some ClickHouse Normalize errors to not have the word normalize by @Amogh-Bharadwaj in #2938
- Dropping ClickHouse mirrors: Cleanup avro stage catalog table by @Amogh-Bharadwaj in #2762
- [dropflow] move metadata_last_sync_state cleanup to last activity by @heavycrystal in #2945
- fix(classifier): missing mv condition by @iamKunalGupta in #2943
- sync flow: explicitly cancel & wait on cancellation before finishing by @serprex in #2951
New Contributors
Full Changelog: v0.28.0...v0.29.0
Contributors
serprex, iskakaushik, and 4 other contributors
Assets 2
v0.28.1
What's Changed
- Update AWS global bundle SHA by @ilidemi in #2923
- Add API test for adding a table before a resync by @Amogh-Bharadwaj in #2918
- Classify missing table on PG by @Amogh-Bharadwaj in #2906
- chore: update dependencies by @serprex in #2925
- mysql: support full range of time by @serprex in #2928
- chore(deps): update postgres:17-alpine docker digest to f325a29 by @renovate in #2930
- fix(deps): update dependency lucide-react to ^0.510.0 by @renovate in #2932
- Classify some mysql errors by @serprex in #2870
- feat(classifier): more nested query cases by @iamKunalGupta in #2921
- chore(deps): update dockerfile dependencies by @renovate in #2929
- chore(deps): update github-actions dependencies by @renovate in #2935
- [mysql] general fixes by @heavycrystal in #2924
- fix(alerting): remove explicit flowName to prevent collision by @iamKunalGupta in #2937
New Contributors
Full Changelog: v0.28.0...v0.28.1
Contributors
serprex, renovate, and 4 other contributors
Assets 2
v0.28.0
v0.28.0
This tag was signed with the committer’s verified signature.
65c40b1
This commit was signed with the committer’s verified signature.
What's Changed
In this release, we've introduced support for IAM auth for our RDS connectors. We have also significantly improved validation of various MySQL setups.
We have also landed the first step to allow NULL engine being chosen as the target ClickHouse table engine type.
On the reliability side, test coverage has been focused on, along with keeping our dependencies upto date.
- improve error logging for query execution by @iskakaushik in #150
- [mysql] don't allow gtid_mode=ON_PERMISSIVE by @heavycrystal in #2876
- [mysql] check GTID mode if needed for validate by @heavycrystal in #2842
- fix(mysql): pass tls config to binlog syncer by @iamKunalGupta in #2877
- coverage, enforce subdirectory coverage by @serprex in #2882
- classify pg connection errors by @serprex in #2884
- e2e: api test custom sync by @serprex in #2886
- e2e: tags api by @serprex in #2887
- e2e: run heartbeat workflow explicitly by @serprex in #2888
- extend pua test coverage to include time by @serprex in #2889
- feat(rds-iam-auth): support for postgres and mysql by @iamKunalGupta in #2881
- ch: null table engine by @serprex in #2892
- [mysql] startup version cannot be trusted by @heavycrystal in #2897
- add field to override hostname for tls by @serprex in #2891
- Support ClickHouse having extra columns compared to source for initial load by @Amogh-Bharadwaj in #2794
- mysql: qrep partitioning by @serprex in #2909
- IAM e2e: skip by @serprex in #2912
- [mysql] mariadb also may not have binlog expiry by @heavycrystal in #2905
- feat(classifier): mark statement timeout related errors as recoverable by @iamKunalGupta in #2916
- Resync fix: update cfg with state before resync calls by @Amogh-Bharadwaj in #2917
Full Changelog: v0.27.7...v0.28.0
Contributors
serprex, iskakaushik, and 3 other contributors