More Web Proxy on the site http://driver.im/

research-article

Performance-Centric Communication in Serverless Functions With TCP Hole Punching

Authors:

Richard Patsch,

Karl Michael GöschkaAuthors Info & Claims

ICCTA '24: Proceedings of the 2024 10th International Conference on Computer Technology Applications

Pages 109 - 115

https://doi.org/10.1145/3674558.3674573

Published: 26 August 2024 Publication History

Abstract

Function as a Service is an established option to deploy event-driven code fragments. Its scalability and cost efficiency through pay-per-use pricing models make it particularly interesting for many use cases. Its isolated nature and statelessness demand rethinking regular software engineering patterns. Communication between several functions is different than it would be in a monolith application. Most functions do not require inter-function exchanges; yet when necessary, options are limited. Leveraging additional services of a cloud service provider increases vendor lock-in. This paper contributes with an approach to enable direct communication between serverless functions, utilizing TCP hole punching. The three largest cloud service providers were tested on applicability and optimal settings. It turned out that TCP hole punching only works with Amazon Web Services, but not in FaaS offerings on Microsoft Azure or Google Cloud. When comparing TCP hole punching with AWS storage service S3, TCP hole punching was significantly faster for data transfers larger than 50 MB. Using the rendezvous server as a relay showed similar performance but is problematic scaling-wise.

References

[1]

Jan vom Brocke, Alan Hevner, and Alexander Maedche. 2020. Introduction to Design Science Research. 1–13.

[2]

Marcin Copik, Roman Böhringer, Alexandru Calotoiu, and Torsten Hoefler. 2023. FMI: Fast and Cheap Message Passing for Serverless Functions. arxiv:2305.08763 [cs.DC]

[3]

Martijn de Heus, Kyriakos Psarakis, Marios Fragkoulis, and Asterios Katsifodimos. 2021. Distributed Transactions on Serverless Stateful Functions. In Proceedings of the 15th ACM International Conference on Distributed and Event-Based Systems (Virtual Event, Italy) (DEBS ’21). Association for Computing Machinery, New York, NY, USA, 31–42. https://doi.org/10.1145/3465480.3466920

Digital Library

[4]

Marco Esposito, Alberto Belli, Lorenzo Palma, and Paola Pierleoni. 2023. Design and Implementation of a Framework for Smart Home Automation Based on Cellular IoT, MQTT, and Serverless Functions. Sensors 23, 9 (2023). https://doi.org/10.3390/s23094459

[5]

Yahoo Finance. 2023. Serverless Computing Market Size 2023. https://finance.yahoo.com/news/serverless-computing-market-size-2023-111100932.html Accessed: 2024-04-24.

[6]

Henrique Fingler, Zhiting Zhu, Esther Yoon, Zhipeng Jia, Emmett Witchel, and Christopher J. Rossbach. 2022. DGSF: Disaggregated GPUs for Serverless Functions. In 2022 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 739–750. https://doi.org/10.1109/IPDPS53621.2022.00077

[7]

Apache Flink. 2024. StateFun: Stateful Functions. https://nightlies.apache.org/flink/flink-statefun-docs-master/ Accessed: 2024-01-03.

[8]

Bryan Ford, Pyda Srisuresh, and Dan Kegel. 2006. Peer-to-Peer Communication Across Network Address Translators. arxiv:cs/0603074 [cs.NI]

[9]

Kaiyu Hou, Sen Lin, Yan Chen, and Vinod Yegneswaran. 2022. QFaaS: Accelerating and Securing Serverless Cloud Networks with QUIC. In Proceedings of the 13th Symposium on Cloud Computing (San Francisco, California) (SoCC ’22). Association for Computing Machinery, New York, NY, USA, 240–256. https://doi.org/10.1145/3542929.3563458

Digital Library

[10]

Zewen Jin, Yiming Zhu, Jiaan Zhu, Dongbo Yu, Cheng Li, Ruichuan Chen, Istemi Ekin Akkus, and Yinlong Xu. 2021. Lessons learned from migrating complex stateful applications onto serverless platforms. In Proceedings of the 12th ACM SIGOPS Asia-Pacific Workshop on Systems (Hong Kong, China) (APSys ’21). Association for Computing Machinery, New York, NY, USA, 89–96. https://doi.org/10.1145/3476886.3477510

Digital Library

[11]

Anurag Khandelwal, Yupeng Tang, Rachit Agarwal, Aditya Akella, and Ion Stoica. 2022. Jiffy: Elastic Far-Memory for Stateful Serverless Analytics. In Proceedings of the Seventeenth European Conference on Computer Systems (Rennes, France) (EuroSys ’22). Association for Computing Machinery, New York, NY, USA, 697–713. https://doi.org/10.1145/3492321.3527539

Digital Library

[12]

Joanna Kijak, Piotr Martyna, Maciej Pawlik, Bartosz Balis, and Maciej Malawski. 2018. Challenges for Scheduling Scientific Workflows on Cloud Functions. In 2018 IEEE 11th International Conference on Cloud Computing (CLOUD). 460–467. https://doi.org/10.1109/CLOUD.2018.00065

[13]

Redis Ltd.2024. Redis. https://redis.io/ Accessed: 2024-01-03.

[14]

Memcached. 2024. Memcached. https://memcached.org/ Accessed: 2024-01-03.

[15]

Memcached. 2024. Memcached. https://www.statista.com/chart/18819/worldwide-market-share-of-leading-cloud-infrastructure-service-providers/ Accessed: 2024-04-05.

[16]

Anna Maria Nestorov, Josep Lluís Berral, Claudia Misale, Chen Wang, David Carrera, and Alaa Youssef. 2022. Floki: A Proactive Data Forwarding System for Direct Inter-Function Communication for Serverless Workflows. In Proceedings of the Eighth International Workshop on Container Technologies and Container Clouds (Quebec, Quebec City, Canada) (WoC ’22). Association for Computing Machinery, New York, NY, USA, 13–18. https://doi.org/10.1145/3565384.3565890

Digital Library

[17]

Richard Patsch and Karl Göschka. 2023. Optimizing the Cost-Performance Ratio of FaaS Deployments. 263–275. https://doi.org/10.1007/978-3-031-46235-1_18

Digital Library

[18]

Shixiong Qi, Leslie Monis, Ziteng Zeng, Ian-chin Wang, and K. K. Ramakrishnan. 2022. SPRIGHT: Extracting the Server from Serverless Computing! High-Performance EBPF-Based Event-Driven, Shared-Memory Processing. In Proceedings of the ACM SIGCOMM 2022 Conference (Amsterdam, Netherlands) (SIGCOMM ’22). Association for Computing Machinery, New York, NY, USA, 780–794. https://doi.org/10.1145/3544216.3544259

Digital Library

[19]

Sterling Quinn, Robert Cordingly, and Wes Lloyd. 2021. Implications of Alternative Serverless Application Control Flow Methods. In Proceedings of the Seventh International Workshop on Serverless Computing (WoSC7) 2021 (Virtual Event, Canada) (WoSC ’21). Association for Computing Machinery, New York, NY, USA, 17–22. https://doi.org/10.1145/3493651.3493668

Digital Library

[20]

Amazon Web Services. 2024. AWS Step-Functions. https://aws.amazon.com/step-functions Accessed: 2024-01-03.

[21]

Hossein Shafiei, Ahmad Khonsari, and Payam Mousavi. 2022. Serverless Computing: A Survey of Opportunities, Challenges, and Applications. ACM Comput. Surv. 54, 11s, Article 239 (nov 2022), 32 pages. https://doi.org/10.1145/3510611

Digital Library

[22]

Vikram Sreekanti, Chenggang Wu, Xiayue Charles Lin, Johann Schleier-Smith, Joseph E. Gonzalez, Joseph M. Hellerstein, and Alexey Tumanov. 2020. Cloudburst: stateful functions-as-a-service. Proceedings of the VLDB Endowment 13, 12 (Aug. 2020), 2438–2452. https://doi.org/10.14778/3407790.3407836

Digital Library

[23]

Satish Narayana Srirama and Mohan Liyanage. 2014. TCP Hole Punching Approach to Address Devices in Mobile Networks. In 2014 International Conference on Future Internet of Things and Cloud. 90–97. https://doi.org/10.1109/FiCloud.2014.24

Digital Library

[24]

Bo Tan, Haikun Liu, Jia Rao, Xiaofei Liao, Hai Jin, and Yu Zhang. 2020. Towards Lightweight Serverless Computing via Unikernel as a Function. In 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS). 1–10. https://doi.org/10.1109/IWQoS49365.2020.9213020

[25]

Michal Wawrzoniak, Ingo Müller, Gustavo Alonso, and Rodrigo Bruno. 2021. Boxer: Data Analytics on Network-enabled Serverless Platforms. In Conference on Innovative Data Systems Research. https://api.semanticscholar.org/CorpusID:231204388

[26]

Jinfeng Wen, Zhenpeng Chen, Xin Jin, and Xuanzhe Liu. 2023. Rise of the Planet of Serverless Computing: A Systematic Review. ACM Trans. Softw. Eng. Methodol. 32, 5, Article 131 (jul 2023), 61 pages. https://doi.org/10.1145/3579643

Digital Library

Cited By

Patsch RGöschka K(2024)Make Applications FaaS-ready: Challenges and GuidelinesProceeding of the 2024 6th International Conference on Information Technology and Computer Communications10.1145/3704391.3704400(57-64)Online publication date: 25-Oct-2024
https://dl.acm.org/doi/10.1145/3704391.3704400

Index Terms

Performance-Centric Communication in Serverless Functions With TCP Hole Punching
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Cloud computing

Recommendations

Serverful Functions: Leveraging Servers in Complex Serverless Workflows (industry track)
Middleware Industrial Track '24: Proceedings of the 25th International Middleware Conference Industrial Track

The scalability of cloud functions makes them a convenient backend for elastic data analytics pipelines where parallelism changes drastically from one stage to the next. However, cloud functions require intermediate storage systems for communication, ...
FaasCache: keeping serverless computing alive with greedy-dual caching
ASPLOS '21: Proceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems

Functions as a Service (also called serverless computing) promises to revolutionize how applications use cloud resources. However, functions suffer from cold-start problems due to the overhead of initializing their code and data dependencies before they ...
Ilúvatar: A Fast Control Plane for Serverless Computing
HPDC '23: Proceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing

Providing efficient Functions as a Service (FaaS) is challenging due to the serverless programming model and highly heterogeneous and dynamic workloads. Great strides have been made in optimizing FaaS performance through scheduling, caching, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICCTA '24: Proceedings of the 2024 10th International Conference on Computer Technology Applications

May 2024

324 pages

ISBN:9798400716386

DOI:10.1145/3674558

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 August 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCTA 2024

ICCTA 2024: 2024 10th International Conference on Computer Technology Applications

May 15 - 17, 2024

Vienna, Austria

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
16
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Patsch RGöschka K(2024)Make Applications FaaS-ready: Challenges and GuidelinesProceeding of the 2024 6th International Conference on Information Technology and Computer Communications10.1145/3704391.3704400(57-64)Online publication date: 25-Oct-2024
https://dl.acm.org/doi/10.1145/3704391.3704400

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents