[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

JAPO: learning join and pushdown order for cloud-native join optimization

  • Letter
  • Published:
Frontiers of Computer Science Aims and scope Submit manuscript

4 Conclusion

In this paper, we introduce JAPO which learn the join and pushdown order through DRL. The main idea is that the DRL agent learns better decisions based on the experiences by monitoring the rewards and latencies via trying different actions. The results show that our method can generate good plans both on join order and pushdown order. We also show that our method can select the well-performed distributed index placement via experiments. In the future, we plan to deploy JAPO to real systems execution and consider more factors in JAPO, such as different join types.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

References

  1. Yu X, Li G, Chai C, Tang N. Reinforcement learning with tree-LSTM for join order selection. In: Proceedings of the 36th IEEE International Conference on Data Engineering (ICDE). 2020, 1297–1308

  2. Cao W, Liu Y, Cheng Z, Zheng N, Li W, Wu W, Ouyang L, Wang P, Wang Y, Kuan R, Liu Z, Zhu F, Zhang T. POLARDB meets computational storage: efficiently support analytical workloads in cloud-native relational database. In: Proceedings of the 18th USENIX Conference on File and Storage Technologies. 2020, 29–42

  3. Huang D, Liu Q, Cui Q, Fang Z, Ma X, Xu F, Shen L, Tang L, Zhou Y, Huang M, Wei W, Liu C, Zhang J, Li J, Wu X, Song L, Sun R, Yu S, Zhao L, Cameron N, Pei L, Tang X. TiDB: a raft-based HTAP database. Proceedings of the VLDB Endowment, 2020, 13(12): 3072–3084

    Article  Google Scholar 

  4. Marcus R, Papaemmanouil O. Deep reinforcement learning for join order enumeration. In: Proceedings of the 1st International Workshop on Exploiting Artificial Intelligence Techniques for Data Management. 2018, 3

  5. Leis V, Gubichev A, Mirchev A, Boncz P, Kemper A, Neumann T. How good are query optimizers, really?. Proceedings of the VLDB Endowment, 2015, 9(3): 204–215

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Software College, Northeastern University, Shenyang, 110819, China

    Yuchen Yuan, Xiaoyue Feng, Bo Zhang, Pengyi Zhang & Jie Song

Authors
  1. Yuchen Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaoyue Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bo Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Pengyi Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jie Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jie Song.

Ethics declarations

Competing interests The authors declare that they have no competing interests or financial conflicts to disclose.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yuan, Y., Feng, X., Zhang, B. et al. JAPO: learning join and pushdown order for cloud-native join optimization. Front. Comput. Sci. 18, 186614 (2024). https://doi.org/10.1007/s11704-024-3937-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11704-024-3937-z

Search

Navigation