8000 Order by for repset_list_tables and README bug by cmotyka · Pull Request #4 · pgEdge/cli · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Order by for repset_list_tables and README bug #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 12, 2023
Merged

Conversation

cmotyka
Copy link
Contributor
@cmotyka cmotyka commented Apr 12, 2023

No description provided.

@cmotyka cmotyka merged commit dea4481 into main Apr 12, 2023
@luss luss deleted the spock-tables branch May 9, 2023 21:27
pct960 added a commit that referenced this pull request Jun 10, 2025
mmols added a commit that referenced this pull request Jun 25, 2025
* Added build-mtree to build a merkle tree for a table

* Fix node_list population

* Also minimise critical section in compare_checksums

* Use same block ranges on all nodes

* Breakthrough: extending a merkle tree on new inserts works

* Sweeping optimisations in table-diff

* Use an optimised sql query instead of get_pkey_offsets

* Fix pkey offsets query

* Added feature to merge blocks on large deletes

* Handle blocks splits and merges inside ACE

* Fix some rebalancing bugs

* Integrate merkle trees into ACE cli

* Update mtree only splits blocks

* Merges happen only when --rebalance=true
is passed

* Adding mtree diff

* First version of mtree diff ready

* Add progress bar for splits and merges

* Use always trigger for tracking dirty blocks

* Update cryptography to address CVE

* No longer using OrderedSet for comparisons

* Handle mismatching tree levels

* Use generic trigger functions

* Initialise mtree objects once per DB node

* More cleanup

* Tweaks to get all base tests to pass

* Use SQL composables; fix rebalance issues

* Unify pkey offset computations

* Add support for specifying a ranges file

* Remove node len check for mtree build

* Update leaf hash during mtree update

* Temp fix for range boundary issue

* Address boundary issues using a lookup table

* Use prepared statements

* Sunset batches option and async rerun

* Add block boundary and repset-diff tests

* Remove explicit stmt.close()

* Add support for composite keys; use stmt triggers

* SQL cleanup

* Add mtree init, teardown; fix block size usage

* Added merkle tree tests

* Use mogrify during repairs

* Prior use of executemany would internally call
execute multiple times, thereby making repairs slow
because of statement triggers from mtrees

* Fix write-ranges to use str by default

* Add support for non-numeric datatypes in tracking triggers

* Fix conn establishment in cleanup

* Address codacy issues

* Addressed more codacy issues

* String literal fix

* Codacy fix #4

* Codacy fix #5

* Use nosemgrep

* More nosemgreps

* Add mtree cli helptext

* Fix metadata task type

* Add metadata tracking for mtree modules

* Move error codes out of config file

* Use a separate consts file

* Revamp ACE CLI invocation

* Group mtree cmds into a sub-cmd
* Treat each of table-diff, -repair, etc. as a top-level sub-cmd

* Update tests

* Fix table names in mtree test

* Minor fixes

* Help texts mostly fixed

* fix fire.py helptext generation for mtree submodule

* generate help for ace mtree submodule

* Backward compatibility fixes

* Rename 'override-block-size' to 'skip-block-size-check' to free up -o
* Add back 'block_rows' as an alias of 'block_size'
* Add back 'behavior' in rerun and mark as deprecated
* Improve merkle tree help text

* Fix tests

* update generated helptext

* Ensure pgcrypto is present

* Fix spock diff

---------

Co-authored-by: Matthew Mols <matt@pgedge.com>
mmols added a commit that referenced this pull request Jun 26, 2025
* Added build-mtree to build a merkle tree for a table

* Fix node_list population

* Also minimise critical section in compare_checksums

* Use same block ranges on all nodes

* Breakthrough: extending a merkle tree on new inserts works

* Sweeping optimisations in table-diff

* Use an optimised sql query instead of get_pkey_offsets

* Fix pkey offsets query

* Added feature to merge blocks on large deletes

* Handle blocks splits and merges inside ACE

* Fix some rebalancing bugs

* Integrate merkle trees into ACE cli

* Update mtree only splits blocks

* Merges happen only when --rebalance=true
is passed

* Adding mtree diff

* First version of mtree diff ready

* Add progress bar for splits and merges

* Use always trigger for tracking dirty blocks

* Update cryptography to address CVE

* No longer using OrderedSet for comparisons

* Handle mismatching tree levels

* Use generic trigger functions

* Initialise mtree objects once per DB node

* More cleanup

* Tweaks to get all base tests to pass

* Use SQL composables; fix rebalance issues

* Unify pkey offset computations

* Add support for specifying a ranges file

* Remove node len check for mtree build

* Update leaf hash during mtree update

* Temp fix for range boundary issue

* Address boundary issues using a lookup table

* Use prepared statements

* Sunset batches option and async rerun

* Add block boundary and repset-diff tests

* Remove explicit stmt.close()

* Add support for composite keys; use stmt triggers

* SQL cleanup

* Add mtree init, teardown; fix block size usage

* Added merkle tree tests

* Use mogrify during repairs

* Prior use of executemany would internally call
execute multiple times, thereby making repairs slow
because of statement triggers from mtrees

* Fix write-ranges to use str by default

* Add support for non-numeric datatypes in tracking triggers

* Fix conn establishment in cleanup

* Address codacy issues

* Addressed more codacy issues

* String literal fix

* Codacy fix #4

* Codacy fix #5

* Use nosemgrep

* More nosemgreps

* Add mtree cli helptext

* Fix metadata task type

* Add metadata tracking for mtree modules

* Move error codes out of config file

* Use a separate consts file

* Revamp ACE CLI invocation

* Group mtree cmds into a sub-cmd
* Treat each of table-diff, -repair, etc. as a top-level sub-cmd

* Update tests

* Fix table names in mtree test

* Minor fixes

* Help texts mostly fixed

* fix fire.py helptext generation for mtree submodule

* generate help for ace mtree submodule

* Backward compatibility fixes

* Rename 'override-block-size' to 'skip-block-size-check' to free up -o
* Add back 'block_rows' as an alias of 'block_size'
* Add back 'behavior' in rerun and mark as deprecated
* Improve merkle tree help text

* Fix tests

* update generated helptext

* Ensure pgcrypto is present

* Fix spock diff

---------

Co-authored-by: Matthew Mols <matt@pgedge.com>
mmols added a commit that referenced this pull request Jun 27, 2025
* Added build-mtree to build a merkle tree for a table

* Fix node_list population

* Also minimise critical section in compare_checksums

* Use same block ranges on all nodes

* Breakthrough: extending a merkle tree on new inserts works

* Sweeping optimisations in table-diff

* Use an optimised sql query instead of get_pkey_offsets

* Fix pkey offsets query

* Added feature to merge blocks on large deletes

* Handle blocks splits and merges inside ACE

* Fix some rebalancing bugs

* Integrate merkle trees into ACE cli

* Update mtree only splits blocks

* Merges happen only when --rebalance=true
is passed

* Adding mtree diff

* First version of mtree diff ready

* Add progress bar for splits and merges

* Use always trigger for tracking dirty blocks

* Update cryptography to address CVE

* No longer using OrderedSet for comparisons

* Handle mismatching tree levels

* Use generic trigger functions

* Initialise mtree objects once per DB node

* More cleanup

* Tweaks to get all base tests to pass

* Use SQL composables; fix rebalance issues

* Unify pkey offset computations

* Add support for specifying a ranges file

* Remove node len check for mtree build

* Update leaf hash during mtree update

* Temp fix for range boundary issue

* Address boundary issues using a lookup table

* Use prepared statements

* Sunset batches option and async rerun

* Add block boundary and repset-diff tests

* Remove explicit stmt.close()

* Add support for composite keys; use stmt triggers

* SQL cleanup

* Add mtree init, teardown; fix block size usage

* Added merkle tree tests

* Use mogrify during repairs

* Prior use of executemany would internally call
execute multiple times, thereby making repairs slow
because of statement triggers from mtrees

* Fix write-ranges to use str by default

* Add support for non-numeric datatypes in tracking triggers

* Fix conn establishment in cleanup

* Address codacy issues

* Addressed more codacy issues

* String literal fix

* Codacy fix #4

* Codacy fix #5

* Use nosemgrep

* More nosemgreps

* Add mtree cli helptext

* Fix metadata task type

* Add metadata tracking for mtree modules

* Move error codes out of config file

* Use a separate consts file

* Revamp ACE CLI invocation

* Group mtree cmds into a sub-cmd
* Treat each of table-diff, -repair, etc. as a top-level sub-cmd

* Update tests

* Fix table names in mtree test

* Minor fixes

* Help texts mostly fixed

* fix fire.py helptext generation for mtree submodule

* generate help for ace mtree submodule

* Backward compatibility fixes

* Rename 'override-block-size' to 'skip-block-size-check' to free up -o
* Add back 'block_rows' as an alias of 'block_size'
* Add back 'behavior' in rerun and mark as deprecated
* Improve merkle tree help text

* Fix tests

* update generated helptext

* Ensure pgcrypto is present

* Fix spock diff

---------

Co-authored-by: Matthew Mols <matt@pgedge.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant
0