[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1007/978-981-97-5552-3_24guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

SLSM: An Efficient Strategy for Lazy Schema Migration on Shared-Nothing Databases

Published: 01 October 2024 Publication History

Abstract

By introducing intermediate states for metadata changes, shared-nothing databases are capable of making online, asynchronous schema changes. However, this method leads to delays in the deployment of new schema since it requires waiting for massive data backfill. To shorten the service vacuum period before the new schema is available, this paper proposes a strategy named SLSM for zero-downtime schema migration on shared-nothing databases. SLSM migrates data from the old schema on-demand before processing incoming transactions on the new schema and addresses the performance issue of this lazy migration. First, it keeps the old and new schema with the same data distribution, reducing the node communication overhead of data migration. Further, SLSM combines data migration with transaction processing by extending the execution plan to allow the data involved in the migration to directly serve the transaction, greatly reducing the waiting time of transaction execution. Experiments demonstrate that our strategy can greatly reduce the latency of transactions and improve the efficiency of data migration compared to existing schemes.

References

[1]
Github online schema change (2016). https://github.com/github/gh-ost
[3]
Bhattacherjee, S., Liao, G., Hicks, M., Abadi, D.J.: Bullfrog: online schema evolution via lazy evaluation. In: Proceedings of the 2021 ACM SIGMOD International Conference on Management of Data, pp. 194–206 (2021)
[4]
De Jong, M., van Deursen, A., Cleve, A.: Zero-downtime SQL database schema evolution for continuous deployment. In: 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Practice Track (ICSE-SEIP), pp. 143–152. IEEE (2017)
[5]
Huang D et al. TiDB: a raft-based HTAP database Proceedings of the VLDB Endowment 2020 13 12 3072-3084
[6]
Ongaro, D., Ousterhout, J.: In search of an understandable consensus algorithm. In: 2014 USENIX annual technical conference (USENIX ATC 14), pp. 305–319 (2014)
[7]
Rae I, Rollins E, Shute J, Sodhi S, and Vingralek R Online, asynchronous schema change in F1 Proc. VLDB Endowment 2013 6 11 1045-1056
[8]
Saur, K., Dumitraş, T., Hicks, M.: Evolving NOSQL databases without downtime. In: 2016 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp. 166–176. IEEE (2016)
[9]
Sheng, Y.: Non-blocking lazy schema changes in multi-version database management systems. CMU MS Thesis (2019)
[10]
Taft, R., et al.: CockroachDB: the resilient geo-distributed SQL database. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, pp. 1493–1509 (2020)
[11]
Xu, C., Si, J., Guan, Z., Zhao, W., Wu, Y., Gao, X.: Reliable conflictive multi-view learning. arXiv preprint arXiv:2402.16897 (2024)
[12]
Zeng, Z., Li, H., Gao, X., Zhang, H., Zhang, H., Cui, J.: SLSM : an efficient strategy for lazy schema migration on shared-nothing databases. arXiv preprint arXiv:2404.03929 (2024)
[13]
Zhu, Y.: Towards Automated Online Schema Evolution. Ph.D. Dissertation. UC Berkeley (2017)

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings
Database Systems for Advanced Applications: 29th International Conference, DASFAA 2024, Gifu, Japan, July 2–5, 2024, Proceedings, Part I
Jul 2024
544 pages
ISBN:978-981-97-5551-6
DOI:10.1007/978-981-97-5552-3

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 October 2024

Author Tags

  1. Shared-nothing database
  2. Lazy migration
  3. Schema change

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 26 Jan 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media