More Web Proxy on the site http://driver.im/

research-article

ProFaaStinate: Delaying Serverless Function Calls to Optimize Platform Performance

Authors:

Trever Schirmer,

Tobias Pfandzelter,

David BermbachAuthors Info & Claims

WoSC '23: Proceedings of the 9th International Workshop on Serverless Computing

Pages 1 - 6

https://doi.org/10.1145/3631295.3631393

Published: 11 December 2023 Publication History

Abstract

Function-as-a-Service (FaaS) enables developers to run serverless applications without managing operational tasks. In current FaaS platforms, both synchronous and asynchronous calls are executed immediately. In this paper, we present ProFaaStinate, which extends serverless platforms to enable delayed execution of asynchronous function calls. This allows platforms to execute calls at convenient times with higher resource availability or lower load. ProFaaStinate is able to optimize performance without requiring deep integration into the rest of the platform, or a complex systems model. In our evaluation, our prototype built on top of Nuclio can reduce request response latency and workflow duration while also preventing the system from being overloaded during load peaks. Using a document preparation use case, we show a 54% reduction in average request response latency. This reduction in resource usage benefits both platforms and users as cost savings.

References

[1]

Daniel Bardsley, Larry Ryan, and John Howard. 2018. Serverless Performance and Optimization Strategies. In Proceedings of the 2018 IEEE International Conference on Smart Cloud (SmartCloud). 19--26. https://doi.org/10.1109/SmartCloud.2018.00012

[2]

David Bermbach, Abhishek Chandra, Chandra Krintz, Aniruddha Gokhale, Aleksander Slominski, Lauritz Thamsen, Everton Cavalcante, Tian Guo, Ivona Brandic, and Rich Wolski. 2021. On the Future of Cloud Engineering. In Proceedings of the 9th IEEE International Conference on Cloud Engineering (San Francisco, CA, USA) (IC2E 2021). ACM, New York, NY, USA, 264--275. https://doi.org/10.1109/IC2E52221.2021.00044

[3]

David Bermbach, Ahmet-Serdar Karakaya, and Simon Buchholz. 2020. Using Application Knowledge to Reduce Cold Starts in FaaS Services. In Proceedings of the 35th ACM Symposium on Applied Computing (Brno, Czech Republic) (SAC '20). ACM, New York, NY, USA, 134--143. https://doi.org/10.1145/3341105.3373909

Digital Library

[4]

Paul Castro, Vatche Ishakian, Vinod Muthusamy, and Aleksander Slominski. 2019. The Rise of Serverless Computing. Commun. ACM 62, 12 (Nov. 2019), 44--54. https://doi.org/10.1145/3368454

Digital Library

[5]

Ryan Chard, Yadu Babuji, Zhuozhao Li, Tyler Skluzacek, Anna Woodard, Ben Blaiszik, Ian Foster, and Kyle Chard. 2020. funcX: A Federated Function Serving Fabric for Science. 65--76. https://doi.org/10.1145/3369583.3392683

Digital Library

[6]

Navraj Chohan, Claris Castillo, Mike Spreitzer, Malgorzata Steinder, Asser Tantawi, and Chandra Krintz. 2010. See Spot Run: Using Spot Instances for {MapReduce} Workflows. In Proceedings of the 2nd USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 10).

[7]

Robert Cordingly, Sonia Xu, and Wesley Lloyd. 2022. Function Memory Optimization for Heterogeneous Serverless Platforms with CPU Time Accounting. In Proceedings of the 10th IEEE International Conference on Cloud Engineering (IC2E 2022).

[8]

Janos Czentye, Istvan Pelle, Andras Kern, Balazs Peter Gero, Laszlo Toka, and Balazs Sonkoly. 2019. Optimizing Latency Sensitive Applications for Amazon's Public Cloud Platform. In Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM).

Digital Library

[9]

Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina Abad, and Alexandru Iosup. 2021. The State of Serverless Applications: Collection, Characterization, and Community Consensus. IEEE Transactions on Software Engineering (2021).

[10]

Simon Eismann, Joel Scheuner, Erwin Van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L Abad, and Alexandru Iosup. 2020. A review of serverless use cases and their characteristics. arXiv preprint arXiv:2008.11110 (2020).

[11]

Simon Eismann, Joel Scheuner, Erwin van Eyk, Maximilian Schwinger, Johannes Grohmann, Nikolas Herbst, Cristina L. Abad, and Alexandru Iosup. 2021. Serverless Applications: Why, When, and How? IEEE Software 38, 1 (2021), 32--39.

Digital Library

[12]

Scott Hendrickson, Stephen Sturdevant, Tyler Harter, Venkateshwaran Venkataramani, Andrea C Arpaci-Dusseau, and Remzi H Arpaci-Dusseau. 2016. Serverless computation with openlambda. In Proceedings of the 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud '16).

Digital Library

[13]

Shay Horovitz, Roei Amos, Ohad Baruch, Tomer Cohen, Tal Oyar, and Afik Deri. 2019. FaaStest - Machine Learning Based Cost and Performance FaaS Optimization. In Proceedings of the Economics of Grids, Clouds, Systems, and Services (Lecture Notes in Computer Science). Springer International Publishing, Cham, 171--186. https://doi.org/10.1007/978-3-030-13342-9_15

Digital Library

[14]

Aman Jain, Ata F. Baarzi, George Kesidis, Bhuvan Urgaonkar, Nader Alfares, and Mahmut Kandemir. 2020. SplitServe: Efficiently Splitting Apache Spark Jobs Across FaaS and IaaS. In Proceedings of the 21st International Middleware Conference. ACM, New York, NY, USA, 236--250. https://doi.org/10.1145/3423211.3425695

Digital Library

[15]

Ashraf Mahgoub, Edgardo Barsallo Yi, Karthick Shankar, Eshaan Minocha, Sameh Elnikety, Saurabh Bagchi, and Somali Chaterji. 2022. WISEFUSE: Workload Characterization and DAG Transformation for Serverless Workflows. In Proceedings of the Abstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS/PERFORMANCE '22). Association for Computing Machinery, New York, NY, USA, 57--58. https://doi.org/10.1145/3489048.3530959

Digital Library

[16]

Johannes Manner, Martin Endreß, Tobias Heckel, and Guido Wirtz. 2018. Cold Start Influencing Factors in Function as a Service. In Proceedings of the 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion).

[17]

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, and Joseph Gonzalez. 2022. Kernel-as-a-Service: A Serverless Interface to GPUs. 221208146 (2022).

[18]

David K. Rensin. 2015. Kubernetes - Scheduling the Future at Cloud Scale. 1005 Gravenstein Highway North Sebastopol, CA 95472.

[19]

Trever Schirmer, Nils Japke, Sofia Greten, Tobias Pfandzelter, and David Bermbach. 2023. The Night Shift: Understanding Performance Variability of Cloud Serverless Platforms. In Proceedings of the 1st Workshop on SErverless Systems, Applications and MEthodologies (Rome, Italy) (SESAME '23). ACM, New York, NY, USA. https://doi.org/10.1145/3592533.3592808

Digital Library

[20]

Trever Schirmer, Joel Scheuner, Tobias Pfandzelter, and David Bermbach. 2022. Fusionize: Improving Serverless Application Performance through Feedback-Driven Function Fusion. In Proceedings of the 10th IEEE International Conference on Cloud Engineering (Asilomar, CA, USA) (IC2E 2022). IEEE, New York, NY, USA, 85--95. https://doi.org/10.1109/IC2E55432.2022.00017

[21]

Josef Spillner, Cristian Mateos, and David A. Monge. 2018. FaaSter, Better, Cheaper: The Prospect of Serverless Scientific Computing and HPC. 796 (2018), 154--168. https://doi.org/10.1007/978-3-319-73353-1_11

[22]

Amoghavarsha Suresh, Gagan Somashekar, Anandh Varadarajan, Veerendra Ramesh Kakarla, Hima Upadhyay, and Anshul Gandhi. 2020. ENSURE: Efficient Scheduling and Autonomous Resource Management in Serverless Environments. In Proceedings of the 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). 1--10. https://doi.org/10.1109/ACSOS49614.2020.00020

[23]

S. Werner and T. Schirmer. 2022. HARDLESS: A Generalized Serverless Compute Architecture for Hardware Processing Accelerators. In Proceedings of the 2022 IEEE International Conference on Cloud Engineering (IC2E). 79--84.

[24]

Hong Zhang, Yupeng Tang, Anurag Khandelwal, Jingrong Chen, and Ion Stoica. 2021. Caerus: NIMBLE Task Scheduling for Serverless Analytics. 653--669. https://www.usenix.org/conference/nsdi21/presentation/zhang-hong

Cited By

Segarra CDurev IPietzuch P(2024)Is It Time To Put Cold Starts In The Deep Freeze?Proceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698527(259-268)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698527
Schirmer TScheuner JPfandzelter TBermbach D(2024)FUSIONIZE++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure OptimizationIEEE Transactions on Cloud Computing10.1109/TCC.2024.345110812:4(1172-1185)Online publication date: Oct-2024
https://doi.org/10.1109/TCC.2024.3451108
Carl VSchirmer TPfandzelter TBermbach D(2024)GeoFF: Federated Serverless Workflows with Data Pre-Fetching2024 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E61754.2024.00023(144-151)Online publication date: 24-Sep-2024
https://doi.org/10.1109/IC2E61754.2024.00023
Show More Cited By

Index Terms

ProFaaStinate: Delaying Serverless Function Calls to Optimize Platform Performance

Recommendations

SeBS: a serverless benchmark suite for function-as-a-service computing
Middleware '21: Proceedings of the 22nd International Middleware Conference

Function-as-a-Service (FaaS) is one of the most promising directions for the future of cloud services, and serverless functions have immediately become a new middleware for building scalable and cost-efficient microservices and appli cations. However, ...
Architectural Implications of Function-as-a-Service Computing
MICRO '52: Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture

Serverless computing is a rapidly growing cloud application model, popularized by Amazon's Lambda platform. Serverless cloud services provide fine-grained provisioning of resources, which scale automatically with user demand. Function-as-a-Service (FaaS)...
An execution model for serverless functions at the edge
IoTDI '19: Proceedings of the International Conference on Internet of Things Design and Implementation

Serverless computing platforms allow developers to host single-purpose applications that automatically scale with demand. In contrast to traditional long-running applications on dedicated, virtualized, or container-based platforms, serverless ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WoSC '23: Proceedings of the 9th International Workshop on Serverless Computing

December 2023

68 pages

ISBN:9798400704550

DOI:10.1145/3631295

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

ACM: Association for Computing Machinery

In-Cooperation

IFIP: International Federation for Information Processing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 December 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

Middleware '23

Sponsor:

ACM

Middleware '23: 24th International Middleware Conference

December 11 - 15, 2023

Bologna, Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
90
Total Downloads

Downloads (Last 12 months)90
Downloads (Last 6 weeks)17

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Segarra CDurev IPietzuch P(2024)Is It Time To Put Cold Starts In The Deep Freeze?Proceedings of the 2024 ACM Symposium on Cloud Computing10.1145/3698038.3698527(259-268)Online publication date: 20-Nov-2024
https://dl.acm.org/doi/10.1145/3698038.3698527
Schirmer TScheuner JPfandzelter TBermbach D(2024)FUSIONIZE++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure OptimizationIEEE Transactions on Cloud Computing10.1109/TCC.2024.345110812:4(1172-1185)Online publication date: Oct-2024
https://doi.org/10.1109/TCC.2024.3451108
Carl VSchirmer TPfandzelter TBermbach D(2024)GeoFF: Federated Serverless Workflows with Data Pre-Fetching2024 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E61754.2024.00023(144-151)Online publication date: 24-Sep-2024
https://doi.org/10.1109/IC2E61754.2024.00023
Moebius FPfandzelter TBermbach D(2024)Are Unikernels Ready for Serverless on the Edge?2024 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E61754.2024.00022(133-143)Online publication date: 24-Sep-2024
https://doi.org/10.1109/IC2E61754.2024.00022

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents