[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3587819.3592554acmconferencesArticle/Chapter ViewAbstractPublication PagesmmsysConference Proceedingsconference-collections
research-article
Open access

VAST: A Decentralized Open-Source Publish/Subscribe Architecture

Published: 08 June 2023 Publication History

Abstract

Publish/Subscribe (pub/sub) systems have been widely adopted in highly scalable environments. We see this especially with IoT/IIoT applications, an environment where low bandwidth and high latency is ideal. The projected growth of Iot/IIoT network nodes are in the billions in the next few years and as such, there is a need for network communication standards that can adapt to the evergrowing nature of this industry. While current pub/sub standards have produced positive results so far, they all adopt a "topic" based pub/sub approach. They do not leverage off modern devices having spatial information. Current open-source standards also focus heavily on centralized brokering of information. This makes the broker in this system a potential bottleneck as it means if that broker goes down, the entire network goes down. We have developed a new, unique and innovative open-source pub/sub standard called VAST that leverages spatial information of modern network devices to perform message communication. It uses a unique concept called Spatial Publish/Subscribe (SPS). It is built on a peer-to-peer network to enable high scalability. In addition to this, it provides a Voronoi Overlay to efficiently distribute the messages, ensuring that network brokers are not overloaded with requests and ensures the network self-organizes itself if one or more brokers break down. It also has a forwarding algorithm to eliminate redundancies in the network. We will demonstrate this concept with a simulator we developed. We will show how the simulator works and how to use it. We believe that with this simulator, we will help encourage researchers adopt this technology for their spatial applications. An example of such is Massively Multi-user Virtual Environments (MMVEs), where there is a need for a high number of spatial network nodes in virtual environments.

References

[1]
Fahd A Alhaidari and Ebtesam J Alqahtani. 2020. Securing Communication between Fog Computing and IoT Using Constrained Application Protocol (CoAP): A Survey. J. Commun. 15, 1 (2020), 14--30.
[2]
Gabriele Baldoni, Julien Loudet, Luca Cominardi, Angelo Corsaro, and Yong He. 2021. Facilitating Distributed Data-Flow Programming with Eclipse Zenoh: The ERDOS Case. In Proceedings of the 1st Workshop on Serverless Mobile Networking for 6G Communications (Virtual, WI, USA) (MobileServerless'21). Association for Computing Machinery, New York, NY, USA, 13--18.
[3]
Balázs Bodó, Jaya Klara Brekke, and Jaap-Henk Hoepman. 2021. Decentralisation: A multidisciplinary perspective. Internet Policy Review 10, 2 (2021), 1--21.
[4]
Keyan Cao, Yefan Liu, Gongjie Meng, and Qimeng Sun. 2020. An overview on edge computing research. IEEE access 8 (2020), 85714--85728.
[5]
Fu Chen, Yujia Huo, Jianming Zhu, and Dan Fan. 2020. A review on the study on MQTT security challenge. In 2020 IEEE International Conference on Smart Cloud (SmartCloud). IEEE, 128--133.
[6]
Ravi Dubey, Yu Li, and Jie Zhang. 2019. Area-of-Interest based optimization for real-time rendering in large-scale MMVEs. J. Parallel and Distrib. Comput. 127 (2019), 1--16.
[7]
Eli Fidler, Hans-Arno Jacobsen, Guoli Li, and Serge Mankovski. 2005. The PADRES Distributed Publish/Subscribe System. In FIW. Citeseer, 12--30.
[8]
Nikos Fotiou, Dirk Trossen, and George C Polyzos. 2012. Illustrating a publish-subscribe internet architecture. Telecommunication Systems 51 (2012), 233--245.
[9]
Eclipse Foundation. [n. d.]. Zenoh - The Zero Overhead, Pub/Sub, Store, Query, and Compute Protocol. https://zenoh.io/
[10]
Fox Geoffrey. 2001. PEER-TO-PEER NETWORKS. COMPUTING IN SCIENCE ENGINEERING 3 (2001), 75 -- 77.
[11]
Leonidas Guibas and Jorge Stolfi. 1985. Primitives for the Manipulation of General Subdivisions and the Computation of Voronoi. ACM Transactions on Graphics (TOG) 4 (1985), 74--123. Issue 2.
[12]
Abhishek Gupta, Ozgur D Sahin, Divyakant Agrawal, and Amr El Abbadi. 2004. Meghdoot: content-based publish/subscribe over p2p networks. In Middleware 2004: ACM/IFIP/USENIX International Middleware Conference, Toronto, Canada, October 18--22, 2004. Proceedings 5. Springer, 254--273.
[13]
Daniel Happ and Adam Wolisz. 2017. Limitations of the Pub/Sub pattern for cloud based IoT and their implications. 2016 Cloudification of the Internet of Things, CIoT 2016 (2017).
[14]
Stefan Herle, Ralf Becker, and Jörg Blankenbach. 2016. Bridging GeoMQTT and REST. In Proceedings of the Geospatial Sensor Webs Conference. 29--31.
[15]
Stefan Herlé, Ralf Bill, and Jörg Manfred Blankenbach. 2019. A GeoEvent-driven architecture based on GeoMQTT for the Geospatial IoT. Ph.D. Dissertation. Geodätisches Institut, Rheinisch-Westfälische Technische Hochschule.
[16]
Shun-Yun Hu. 2005. Scalable Peer-to-Peer Networked Virtual Environment.
[17]
Shun-yun Hu. 2009. Spatial Publish Subscribe. IEEE Virtual Reality (IEEE VR) (2009), 6. http://pap.vs.uni-due.de/MMVE09/papers/p8.pdf
[18]
Shun-Yun Hu, Chen, and Tsu-Han Chen. 2006. VON: A Scalable Peer-to-Peer Network for Virtual Environments. IEEE Network Magazine (2006).
[19]
Shun-Yun Hu and Kuan-Ta Chen. 2011. VSO: Self-Organizing Spatial Publish Subscribe. In 2011 IEEE Fifth International Conference on Self-Adaptive and Self-Organizing Systems. 21--30.
[20]
Shun Yun Hu and Guan Ming Liao. 2004. Scalable peer-to-peer networked virtual environment. Proceedings of the ACM SIGCOMM Workshop on Network and System Support for Games, NetGames'04 (2004), 129--133.
[21]
Mats Ake Hugoson. 2008. Centralized versus Decentralized Information Systems: A Historical Flashback. IFIP Advances in Information and Communication Technology 303 (2008), 106--115.
[22]
Imonology Inc. [n.d.]. How to use VAST.js Simulator and Visualizer - YouTube. https://www.youtube.com/watch?v=2_X-TwGXcRs
[23]
Imonology Inc. [n. d.]. VAST.js. https://github.com/imonology/VAST.js/tree/dev_CFM
[24]
Yoshio Inoue. 2020. Satellite- and drone-based remote sensing of crops and soils for smart farming - a review. Soil Science and Plant Nutrition 66, 6 (2020), 798--810.
[25]
Laura Itzel, Florian Heger, Gregor Schiele, and Christian Becker. 2011. The quest for meaningful mobility in massively multi-user virtual environments. In 2011 10th Annual Workshop on Network and Systems Support for Games. IEEE, 1--2.
[26]
Hans-Arno Jacobsen. 2009. Publish/Subscribe. Springer US, Boston, MA, 2208--2211.
[27]
Jehn Ruey Jiang, Yu Li Huang, and Shun Yun Hu. 2009. Scalable AOI-cast for peer-to-peer networked virtual environments. Journal of Internet Technology 10 (2009), 119--125. Issue 2.
[28]
Reza Sherafat Kazemzadeh and Hans-Arno Jacobsen. 2009. Reliable and highly available distributed publish/subscribe service. In 2009 28th IEEE International Symposium on Reliable Distributed Systems. IEEE, 41--50.
[29]
Dmitrij Lagutin, Kari Visala, and Sasu Tarkoma. 2010. Publish/subscribe for internet: PSIRP perspective. Towards the Future Internet: Emerging Trends from European Research 4 (2010), 75--84.
[30]
Robin Jan Maly, Jan Mischke, Pascal Kurtansky, and Burkhard Stiller. 2003. Comparison of centralized (client-server) and decentralized (peer-to-peer) networking. Semester thesis, ETH Zurich, Zurich, Switzerland (2003), 1--12.
[31]
Charl Marais. 2021. Extending VAST to Support Distributed Spatial Publish and Subscribe. www.eng.sun.ac.za
[32]
Mario Marchese, Aya Moheddine, and Fabio Patrone. 2019. IoT and UAV Integration in 5G Hybrid Terrestrial-Satellite Networks. Sensors 19, 17 (2019).
[33]
MQTT.org. [n.d.]. MQTT - The Standard for IoT Messaging. https://mqtt.org/
[34]
Michael Nast, Hannes Raddatz, Benjamin Rother, Frank Golatowski, and Dirk Timmermann. 2022. A Survey and Comparison of Publish/Subscribe Protocols for the Industrial Internet of Things (IIoT). (2022).
[35]
Paessler. [n. d.]. What is MQTT? Definition and Details. https://www.paessler.com/it-explained/mqtt
[36]
Matthew Riordan. 2020. Publish-Subscribe: Introduction to Scalable Messaging - The New Stack. https://thenewstack.io/publish-subscribe-introduction-to-scalable-messaging/
[37]
Karen Rose, Scott Eldridge, and Lyman Chapin. [n. d.]. The Internet of Things: An Overview Understanding the Issues and Challenges of a More Connected World. ([n. d.]).
[38]
Miguel Smith. 2020. VAST : a scalable spatial publish and subscribe system integrated with Minecraft by. Issue March. http://hdl.handle.net/10019.1/108007
[39]
Dipa Soni and Ashwin Makwana. 2017. A survey on mqtt: a protocol of internet of things(IoT). International Conference on Telecommunication, Power Analysis and Computing Techniques (Ictpact - 2017) (2017), 0--5. Issue April.
[40]
Darius Suchojad. 2019. Publish/subscribe, Zato services and asynchronous API integrations. https://zato.io/blog/posts/pubsub-service.html
[41]
Richard Sueselbeck, Gregor Schiele, Sebastian Seitz, and Christian Becker. 2009. Adaptive update propagation for low-latency massively multi-user virtual environments. In 2009 Proceedings of 18th International Conference on Computer Communications and Networks. IEEE, 1--6.
[42]
Steve Vinoski. 2006. Advanced message queuing protocol. IEEE Internet Computing 10, 6 (2006), 87--89.

Cited By

View all

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
MMSys '23: Proceedings of the 14th ACM Multimedia Systems Conference
June 2023
495 pages
ISBN:9798400701481
DOI:10.1145/3587819
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2023

Check for updates

Author Tags

  1. open-source
  2. publish/subscribe
  3. pub/sub
  4. spatial publish/subscribe
  5. VAST
  6. voronoi partitioning
  7. MQTT
  8. IoT
  9. IIoT
  10. MMVE

Qualifiers

  • Research-article

Conference

MMSys '23
Sponsor:
MMSys '23: 14th Conference on ACM Multimedia Systems
June 7 - 10, 2023
BC, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 523
    Total Downloads
  • Downloads (Last 12 months)343
  • Downloads (Last 6 weeks)20
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media