More Web Proxy on the site http://driver.im/

research-article

Triggerflow: : Trigger-based orchestration of serverless workflows

Authors:

Pedro García López,

Aleksander Slominski,

Lionel VillardAuthors Info & Claims

Volume 124, Issue C

Pages 215 - 229

https://doi.org/10.1016/j.future.2021.06.004

Published: 01 November 2021 Publication History

Abstract

As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support the native life cycle execution of those applications in the data center.

But existing cloud orchestration systems either focus on short-running workflows (like IBM Composer or Amazon Step Functions Express Workflows) or impose considerable overheads for synchronizing massively parallel jobs (Azure Durable Functions, Amazon Step Functions). None of them are open systems enabling extensible interception and optimization of custom workflows.

We present Triggerflow: an extensible Trigger-based Orchestration architecture for serverless workflows. We demonstrate that Triggerflow is a novel serverless building block capable of constructing different reactive orchestrators (State Machines, Directed Acyclic Graphs, Workflow as code, Federated Learning orchestrator). We also validate that it can support high-volume event processing workloads, auto-scale on demand with scale down to zero when not used, and transparently guarantee fault tolerance and efficient resource usage when orchestrating long running scientific workflows.

Highlights

•

Analysis of current serverless orchestration systems for scientific workflows.

•

Specification of a novel trigger-based architecture for serverless orchestration.

•

Demonstration of how Triggerflow orchestrates DAGs, state machines, workflow as code.

•

Prototype implementation of the serverless auto-scalable architecture on Kubernetes.

•

Evaluation of serverless orchestration performance, fault tolerance and efficiency.

References

[1]

Jonas E., Pu Q., Venkataraman S., Stoica I., Recht B., Occupy the cloud: Distributed computing for the 99%, in: Proceedings of the 2017 Symposium on Cloud Computing, ACM, 2017, pp. 445–451.

[2]

Fouladi S., Wahby R.S., Shacklett B., Balasubramaniam K.V., Zeng W., Bhalerao R., Sivaraman A., Porter G., Winstein K., Encoding, fast and slow: Low-latency video processing using thousands of tiny threads, in: 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), 2017, pp. 363–376.

[3]

T. Wagner, The Serverless Supercomputer, https://read.acloud.guru/https-medium-com-timawagner-the-serverless-supercomputer-555e93bbfa08.

[4]

López P.G., Sánchez-Artigas M., París G., Pons D.B., Ollobarren Á.R., Pinto D.A., Comparison of faas orchestration systems, in: 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion), IEEE, 2018, pp. 148–153.

[5]

Barcelona-Pons D., García-López P., Ruiz A., Gómez-Gómez A., París G., Sánchez-Artigas M., FaaS orchestration of parallel workloads, in: Proceedings of the 5th International Workshop on Serverless Computing, in: WOSC ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 25–30,.

Digital Library

[6]

Sampe J., Garcia-Lopez P., Sanchez-Artigas M., Vernik G., Roca-Llaberia P., Arjona A., Towards multicloud access transparency in serverless computing, IEEE Softw. (2020),.

Digital Library

[7]

Triggerflow, https://github.com/triggerflow/triggerflow.

[8]

Paton N.W., Díaz O., Active database systems, ACM Comput. Surv. 31 (1) (1999) 63–103.

[9]

Mitchell C., Power R., Li J., Oolong: asynchronous distributed applications made easy, in: Proceedings of the Asia-Pacific Workshop on Systems, ACM, 2012, p. 11.

[10]

Han S., Ratnasamy S., Large-scale computation not at the cost of expressiveness, in: Presented as Part of the 14th Workshop on Hot Topics in Operating Systems, 2013.

[11]

Geppert A., Tombros D., Event-based distributed workflow execution with EVE, in: Middleware’98, Springer, 1998, pp. 427–442.

[12]

Chen W., Wei J., Wu G., Qiao X., Developing a concurrent service orchestration engine based on event-driven architecture, in: OTM Confederated International Conferences” on the Move to Meaningful Internet Systems”, Springer, 2008, pp. 675–690.

[13]

Binder W., Constantinescu I., Faltings B., Decentralized orchestration of composite web services, in: 2006 IEEE International Conference on Web Services (ICWS’06), IEEE, 2006, pp. 869–876.

[14]

Li G., Jacobsen H.-A., Composite subscriptions in content-based publish/subscribe systems, in: ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing, Springer, 2005, pp. 249–269.

[15]

Dai D., Chen Y., Kimpe D., Ross R., Trigger-based incremental data processing with unified sync and async model, IEEE Trans. Cloud Comput. (2018).

[16]

Soffer P., Hinze A., Koschmider A., Ziekow H., Di Ciccio C., Koldehofe B., Kopp O., Jacobsen A., Sürmeli J., Song W., From event streams to process models and back: Challenges and opportunities, Inf. Syst. 81 (2019) 181–200.

Digital Library

[17]

I. Baldini, P. Cheng, S.J. Fink, N. Mitchell, V. Muthusamy, R. Rabbah, P. Suter, O. Tardieu, The serverless trilemma: Function composition for serverless computing, in: Proceedings of the 2017 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, Onward! 2017, 2017, pp. 89–103.

[18]

CNCF, Serverless Workflow, https://serverlessworkflow.io/.

[19]

Carver B., Zhang J., Wang A., Cheng Y., In search of a fast and efficient serverless DAG engine, 2019, arxiv preprint arXiv:1910.05896.

[20]

Joyner S., MacCoss M., Delimitrou C., Weatherspoon H., Ripple: A practical declarative programming framework for serverless compute, 2020, arxiv preprint arXiv:2001.00222.

[21]

Malawski M., Gajek A., Zima A., Balis B., Figiela K., Serverless execution of scientific workflows: experiments with hyperflow, aws lambda and google cloud functions, Future Generation Comput. Syst. (ISSN ) 110 (2020) 502–514,. https://www.sciencedirect.com/science/article/pii/S0167739X1730047X.

[22]

Jangda A., Pinckney D., Brun Y., Guha A., Formal foundations of serverless computing, Proc. ACM Program. Lang. 3 (OOPSLA) (2019) 1–26.

[23]

Van Eyk E., Grohmann J., Eismann S., Bauer A., Versluis L., Toader L., Schmitt N., Herbst N., Abad C., Iosup A., The SPEC-RG reference architecture for FaaS: From microservices and containers to serverless platforms, IEEE Internet Comput. (2019).

[24]

Fouladi S., Romero F., Iter D., Li Q., Chatterjee S., Kozyrakis C., Zaharia M., Winstein K., From laptop to lambda: Outsourcing everyday jobs to thousands of transient functional containers, in: 2019 USENIX Annual Technical Conference (USENIX ATC 19), USENIX Association, Renton, WA, 2019, pp. 475–488. URL https://www.usenix.org/conference/atc19/presentation/fouladi.

[25]

Burckhardt S., Gillum C., Justo D., Kallas K., McMahon C., Meiklejohn C.S., Serverless workflows with durable functions and netherite, 2021, arXiv:2103.00033.

[26]

KEDA, Kubernetes-based event-driven autoscaling, https://keda.sh/.

[27]

Knative, Experimental KEDA support for Knative Event Sources Autoscaling, https://github.com/knative-sandbox/eventing-autoscaler-keda.

[28]

Bonawitz K., Eichner H., Grieskamp W., Huba D., Ingerman A., Ivanov V., Kiddon C., Konečnỳ J., Mazzocchi S., McMahan H.B., et al., Towards federated learning at scale: System design, 2019, arxiv preprint arXiv:1902.01046.

[29]

Hard A., Rao K., Mathews R., Ramaswamy S., Beaufays F., Augenstein S., Eichner H., Kiddon C., Ramage D., Federated learning for mobile keyboard prediction, 2019, arXiv:1811.03604.

[30]

Berriman B., Deelman E., Good J., Jacob J., Katz D.S., Kesselman C., Laity A., Prince T., Singh G., Su M.-H., Montage: A grid enabled engine for delivering custom science-grade mosaics on demand, 5493, 2004,.

[31]

Grandl R., Singhvi A., Viswanathan R., Akella A., Whiz: A fast and flexible data analytics system, 2017, arXiv:1703.10272.

Cited By

Wang YChen PDou HZhang YYu GHe ZHuang HFilkov VRay BZhou M(2024)FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless WorkflowsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695477(957-969)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695477
Triendl SRistov SBalsamo SKnottenbelt WAbad CShang W(2024)Peeking Behind the Serverless Implementations and Deployments of the Montage WorkflowCompanion of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629527.3651420(196-203)Online publication date: 7-May-2024
https://dl.acm.org/doi/10.1145/3629527.3651420
Eizaguirre GSánchez-Artigas M(2024)A Seer knows bestJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104763183:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104763
Show More Cited By

Index Terms

Triggerflow: Trigger-based orchestration of serverless workflows

Index terms have been assigned to the content through auto-classification.

Recommendations

Triggerflow: trigger-based orchestration of serverless workflows
DEBS '20: Proceedings of the 14th ACM International Conference on Distributed and Event-based Systems

As more applications are being moved to the Cloud thanks to serverless computing, it is increasingly necessary to support native life cycle execution of those applications in the data center.

But existing systems either focus on short-running workflows (...
FaaS Orchestration of Parallel Workloads
WOSC '19: Proceedings of the 5th International Workshop on Serverless Computing

Function as a Service (FaaS) is based on a reactive programming model where functions are activated by triggers in response to cloud events (e.g., objects added to an object store). The inherent elasticity and the pay-per-use model of serverless ...
Apollo: towards an efficient distributed orchestration of serverless function compositions in the cloud-edge continuum
UCC '21: Proceedings of the 14th IEEE/ACM International Conference on Utility and Cloud Computing

This paper provides a first presentation of Apollo, an orchestration framework for serverless function compositions distributed across the cloud-edge continuum. Apollo has a modular design that enables a fine-grained decomposition of the runtime ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Future Generation Computer Systems

Future Generation Computer Systems Volume 124, Issue C

Nov 2021

497 pages

ISSN:0167-739X

Issue’s Table of Contents

The Author(s).

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 November 2021

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang YChen PDou HZhang YYu GHe ZHuang HFilkov VRay BZhou M(2024)FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless WorkflowsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695477(957-969)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695477
Triendl SRistov SBalsamo SKnottenbelt WAbad CShang W(2024)Peeking Behind the Serverless Implementations and Deployments of the Montage WorkflowCompanion of the 15th ACM/SPEC International Conference on Performance Engineering10.1145/3629527.3651420(196-203)Online publication date: 7-May-2024
https://dl.acm.org/doi/10.1145/3629527.3651420
Eizaguirre GSánchez-Artigas M(2024)A Seer knows bestJournal of Parallel and Distributed Computing10.1016/j.jpdc.2023.104763183:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.jpdc.2023.104763
Ristov SBrandacher SHautz MFelderer MBreu R(2024) CODEFuture Generation Computer Systems10.1016/j.future.2024.06.017160:C(442-456)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1016/j.future.2024.06.017
Bharti UGoel AGupta S(2023)ReactiveFnJ: A choreographed model for Fork-Join Workflow in Serverless ComputingJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-023-00429-312:1Online publication date: 24-Apr-2023
https://dl.acm.org/doi/10.1186/s13677-023-00429-3
Hautz MRistov SFelderer M(2023)Characterizing AFCL Serverless Scientific Workflows in Federated FaaSProceedings of the 9th International Workshop on Serverless Computing10.1145/3631295.3631397(24-29)Online publication date: 11-Dec-2023
https://dl.acm.org/doi/10.1145/3631295.3631397
Aldinucci MBaralis ECardellini VColonnelli IDanelutto MDecherchi SDi Modica GFerrucci LGribaudo MIannone FLapegna MMedic DMuscianisi GRighetti FSciacca ETonellotto NTortonesi MTrunfio PVardanega T(2023)A Systematic Mapping Study of Italian Research on WorkflowsProceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis10.1145/3624062.3624285(2065-2076)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3624062.3624285
Castagna FTrombetta ALandoni MAndreon S(2023)A Serverless Architecture for Efficient and Scalable Monte Carlo Markov Chain ComputationProceedings of the 2023 7th International Conference on Cloud and Big Data Computing10.1145/3616131.3616141(68-73)Online publication date: 17-Aug-2023
https://dl.acm.org/doi/10.1145/3616131.3616141
Shrestha SLi ZMottakin KSong ZZhu QSha KBanerjee SChen J(2023)From Tight Coupling to Flexibility: A Digital Twin Middleware Layer for the ShakeAlert SystemProceedings of the Eighth ACM/IEEE Symposium on Edge Computing10.1145/3583740.3626805(313-318)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3583740.3626805
Ristov SFarahani RProdan RVieira MCardellini VDi Marco ATuma P(2023)Large-scale Graph Processing and Simulation with Serverless Workflows in Federated FaaSCompanion of the 2023 ACM/SPEC International Conference on Performance Engineering10.1145/3578245.3585333(227-231)Online publication date: 15-Apr-2023
https://dl.acm.org/doi/10.1145/3578245.3585333
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents