[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3662158.3662791acmconferencesArticle/Chapter ViewAbstractPublication PagespodcConference Proceedingsconference-collections
research-article
Open access

Universally Optimal Information Dissemination and Shortest Paths in the HYBRID Distributed Model

Published: 17 June 2024 Publication History

Abstract

In most modern networks, nodes have access to various modes of communication each with different characteristics. In this work we consider the Hybrid model of distributed computing, introduced recently by Augustine, Hinnenthal, Kuhn, Scheideler, and Schneider (SODA 2020), where nodes have access to two different communication modes: high-bandwidth local communication along the edges of the graph and low-bandwidth all-to-all communication, capturing the non-uniform nature of modern communication networks. It is noteworthy that the Hybrid model in its most general form covers most of the classical distributed models as marginal cases.
Prior work in Hybrid has focused on showing existentially optimal algorithms, meaning there exists a pathological family of instances on which no algorithm can do better. This neglects the fact that such worst-case instances often do not appear or can be actively avoided in practice. In this work, we focus on the notion of universal optimality, first raised by Garay, Kutten, and Peleg (FOCS 1993). Roughly speaking, a universally optimal algorithm is one that, given any input graph, runs as fast as the best algorithm designed specifically for that graph.
We show the first universally optimal algorithms in Hybrid, up to polylogarithmic factors. We present universally optimal solutions for fundamental tools that solve information dissemination problems, such as broadcasting and unicasting multiple messages in a Hybrid network. Furthermore, we demonstrate these tools for information dissemination can be used to obtain universally optimal solutions for various shortest paths problems in Hybrid. A major conceptual contribution of this work is the conception of a new graph parameter called neighborhood quality that captures the inherent complexity of many fundamental graph problems in the Hybrid model. We also develop new existentially optimal shortest paths algorithms in Hybrid, which are utilized as key subroutines in our universally optimal algorithms and are of independent interest. Our new approximation algorithms for k-source shortest paths match the existing [EQUATION] lower bound for all k. Previously, the lower bound was only known to be tight when k ∈ Ω(n2/3).

Supplementary Material

PDF File (p380-supp.pdf)
Supplemental material.

References

[1]
Ioannis Anagnostides and Themis Gouleakis. 2021. Deterministic Distributed Algorithms and Lower Bounds in the Hybrid Model. In Proceedings of the 35th International Symposium on Distributed Computing (DISC), Vol. 209. 5:1--5:19.
[2]
Ioannis Anagnostides and Themis Gouleakis. 2021. Deterministic Distributed Algorithms and Lower Bounds in the Hybrid Model. In 35th International Symposium on Distributed Computing. 5:1--5:19.
[3]
John Augustine, Keerti Choudhary, Avi Cohen, David Peleg, Sumathi Sivasubramaniam, and Suman Sourav. 2021. Distributed graph realizations. IEEE transactions on parallel and distributed systems 33, 6 (2021), 1321--1337.
[4]
John Augustine, Mohsen Ghaffari, Robert Gmyr, Kristian Hinnenthal, Christian Scheideler, Fabian Kuhn, and Jason Li. 2019. Distributed Computation in Node-Capacitated Networks. In Proceedings of the 31st ACM Symposium on Parallelism in Algorithms and Architectures (SPAA). 69--79.
[5]
John Augustine, Kristian Hinnenthal, Fabian Kuhn, Christian Scheideler, and Philipp Schneider. 2020. Shortest paths in a hybrid network model. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms (SODA). SIAM, 1280--1299.
[6]
Leonid Barenboim and Michael Elkin. 2010. Sublogarithmic distributed MIS algorithm for sparse graphs using Nash-Williams decomposition. Distributed Computing 22, 5-6 (2010), 363--379.
[7]
Florent Becker, Antonio Fernandez Anta, Ivan Rapaport, and Eric Reémila. 2015. Brief Announcement: A Hierarchy of Congested Clique Models, from Broadcast to Unicast. In Proceedings of the 2015 ACM Symposium on Principles of Distributed Computing (PODC). 167--169.
[8]
Florent Becker, Pedro Montealegre, Ivan Rapaport, and Ioan Todinca. 2020. The impact of locality in the broadcast congested clique model. SIAM Journal on Discrete Mathematics 34, 1 (2020), 682--700.
[9]
Keren Censor-Hillel, Dean Leitersdorf, and Volodymyr Polosukhin. 2021. Distance Computations in the Hybrid Network Model via Oracle Simulations. In Proceedings of the 38th Symposium on Theoretical Aspects of Computer Science (STACS). Schloss Dagstuhl-Leibniz-Zentrum für Informatik, 21:1--21:19.
[10]
Keren Censor-Hillel, Dean Leitersdorf, and Volodymyr Polosukhin. 2021. On sparsity awareness in distributed computations. In Proceedings of the 33rd ACM Symposium on Parallelism in Algorithms and Architectures (SPAA). 151--161.
[11]
Yi-Jun Chang, Oren Hecht, Dean Leitersdorf, and Philipp Schneider. 2023. Universally Optimal Information Dissemination and Shortest Paths in the HYBRID Distributed Model. arXiv:2311.09548v2 [cs.DC]
[12]
Lijie Chen and Ofer Grossman. 2019. Broadcast congested clique: Planted cliques and pseudorandom generators. In Proceedings of the 2019 ACM Symposium on Principles of Distributed Computing (PODC). 248--255.
[13]
Sam Coy, Artur Czumaj, Michael Feldmann, Kristian Hinnenthal, Fabian Kuhn, Christian Scheideler, Philipp Schneider, and Martijn Struijs. 2022. Near-Shortest Path Routing in Hybrid Communication Networks. In Proceedings of the 25th International Conference on Principles of Distributed Systems (OPODIS 2021). 11:1--11:23.
[14]
Sam Coy, Artur Czumaj, Christian Scheideler, Philipp Schneider, and Julian Werthmann. 2023. Routing Schemes for Hybrid Communication Networks. In Proceedings of the 30th International Colloquium on Structural Information and Communication Complexity (SIROCCO). Springer, 317--338.
[15]
Andrew Drucker, Fabian Kuhn, and Rotem Oshman. 2014. On the Power of the Congested Clique Model. In Proceedings of the 2014 ACM Symposium on Principles of Distributed Computing (PODC). 367--376.
[16]
Nathan Farrington, George Porter, Sivasankar Radhakrishnan, Hamid Hajabdolali Bazzaz, Vikram Subramanya, Yeshaiahu Fainman, George Papen, and Amin Vahdat. 2010. Helios: a hybrid electrical/optical switch architecture for modular data centers. In Proceedings of the ACM SIGCOMM 2010 Conference. 339--350.
[17]
Michael Feldmann, Kristian Hinnenthal, and Christian Scheideler. 2021. Fast Hybrid Network Algorithms for Shortest Paths in Sparse Graphs. In Proceedings of the 24th International Conference on Principles of Distributed Systems (OPODIS 2020). 31:1--31:16.
[18]
Juan A. Garay, Shay Kutten, and David Peleg. 1998. A SubLinear Time Distributed Algorithm for Minimum-Weight Spanning Trees. SIAM J. Comput. 27, 1 (Feb. 1998), 302--316.
[19]
Robert Gmyr, Kristian Hinnenthal, Christian Scheideler, and Christian Sohler. 2017. Distributed monitoring of network properties: The power of hybrid networks. In Proceedings of the 44th International Colloquium on Automata, Languages, and Programming (ICALP). 137:1--137:15.
[20]
Bernhard Haeupler, David Wajc, and Goran Zuzic. 2021. Universally-optimal distributed algorithms for known topologies. In Proceedings of the 53rd Annual ACM SIGACT Symposium on Theory of Computing (STOC). 1166--1179.
[21]
Daniel Halperin, Srikanth Kandula, Jitendra Padhye, Paramvir Bahl, and David Wetherall. 2011. Augmenting data center networks with multi-gigabit wireless links. In Proceedings of the ACM SIGCOMM 2011 Conference. 38--49.
[22]
Stephan Holzer and Nathan Pinsker. 2016. Approximation of Distances and Shortest Paths in the Broadcast Congest Clique. In Proceedings of the 19th International Conference on Principles of Distributed Systems (OPODIS 2015) (Leibniz International Proceedings in Informatics (LIPIcs), Vol. 46), Emmanuelle Anceaume, Christian Cachin, and Maria Potop-Butucaru (Eds.). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik, Dagstuhl, Germany, 1--16.
[23]
Tomasz Jurdziński and Krzysztof Nowicki. 2018. Connectivity and minimum cut approximation in the broadcast congested clique. In Proceedings of the 25th International Colloquium on Structural Information and Communication Complexity (SIROCCO). Springer, 331--344.
[24]
Udit Narayana Kar and Debarshi Kumar Sanyal. 2018. An overview of device-to-device communication in cellular networks. ICT express 4, 4 (2018), 203--208.
[25]
Fabian Kuhn and Philipp Schneider. 2020. Computing shortest paths and diameter in the hybrid network model. In Proceedings of the 39th Symposium on Principles of Distributed Computing (PODC). 109--118.
[26]
Fabian Kuhn and Philipp Schneider. 2022. Routing Schemes and Distance Oracles in the Hybrid Model. In International Symposium on Distributed Computing (DISC), Vol. 246. 28:1--28:22.
[27]
Christoph Lenzen. 2013. Optimal deterministic routing and sorting on the congested clique. In Principles of Distr. Comp. (PODC). 42--50.
[28]
Nathan Linial. 1992. Locality in distributed graph algorithms. SIAM Journal on computing 21, 1 (1992), 193--201.
[29]
Pedro Montealegre and Ioan Todinca. 2016. Brief announcement: deterministic graph connectivity in the broadcast congested clique. In Proceedings of the 2016 ACM Symposium on Principles of Distributed Computing (PODC). 245--247.
[30]
Michael Rossberg and Guenter Schaefer. 2011. A Survey on Automatic Configuration of Virtual Private Networks. Computer Networks 55, 8 (2011), 1684--1699.
[31]
Václav Rozhoň and Mohsen Ghaffari. 2020. Polylogarithmic-time deterministic network decomposition and distributed derandomization. In Proceedings of the 52nd Annual ACM SIGACT Symposium on Theory of Computing (STOC). 350--363.
[32]
Václav Rozhoň, Christoph Grunau, Bernhard Haeupler, Goran Zuzic, and Jason Li. 2022. Undirected (1 + ϵ)-shortest paths via minor-aggregates: near-optimal deterministic parallel and distributed algorithms. In Proceedings of the 54th Annual ACM SIGACT Symposium on Theory of Computing (STOC). 478--487.
[33]
Philipp Schneider. 2023. Power and Limitations of Hybrid Communication Networks. Ph. D. Dissertation. University of Freiburg.
[34]
Claude Elwood Shannon. 1948. A mathematical theory of communication. The Bell system technical journal 27, 3 (1948), 379--423.
[35]
Jeffrey D. Ullman and Mihalis Yannakakis. 1991. High-Probability Parallel Transitive-Closure Algorithms. SIAM J. Comput. 20, 1 (1991), 100--125.
[36]
Shu-ping Yeh, Shilpa Talwar, Geng Wu, Nageen Himayat, and Kerstin Johnsson. 2011. Capacity and coverage enhancement in heterogeneous networks. IEEE Wirel. Commun. 18, 3 (2011), 32--38.

Cited By

View all
  • (2024)A Prediction Model for Network Information Dissemination based on Optimized Convolutional Neural Network Using Enhanced Kepler Optimization2024 International Conference on Intelligent Algorithms for Computational Intelligence Systems (IACIS)10.1109/IACIS61494.2024.10722006(1-5)Online publication date: 23-Aug-2024

Index Terms

  1. Universally Optimal Information Dissemination and Shortest Paths in the HYBRID Distributed Model

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    PODC '24: Proceedings of the 43rd ACM Symposium on Principles of Distributed Computing
    June 2024
    570 pages
    ISBN:9798400706684
    DOI:10.1145/3662158
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 17 June 2024

    Check for updates

    Author Tags

    1. APSP
    2. broadcast
    3. overlay network
    4. universal optimality

    Qualifiers

    • Research-article

    Conference

    PODC '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 740 of 2,477 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)109
    • Downloads (Last 6 weeks)34
    Reflects downloads up to 13 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Prediction Model for Network Information Dissemination based on Optimized Convolutional Neural Network Using Enhanced Kepler Optimization2024 International Conference on Intelligent Algorithms for Computational Intelligence Systems (IACIS)10.1109/IACIS61494.2024.10722006(1-5)Online publication date: 23-Aug-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media