More Web Proxy on the site http://driver.im/

research-article

Open access

Transactional Causal Consistency for Serverless Computing

Authors:

Vikram Sreekanti,

Joseph M. HellersteinAuthors Info & Claims

SIGMOD '20: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data

Pages 83 - 97

https://doi.org/10.1145/3318464.3389710

Published: 31 May 2020 Publication History

Abstract

We consider the setting of serverless Function-as-a-Service (FaaS) platforms, where storage services are disaggregated from the machines that support function execution. FaaS applications consist of compositions of functions, each of which may run on a separate machine and access remote storage. The challenge we address is improving I/O latency in this setting while also providing application-wide consistency. Previous work has explored providing causal consistency for individual I/Os by carefully managing the versions stored in a client-side data cache. In our setting, a single application may execute multiple functions across different nodes, and therefore issue interrelated I/Os to multiple distinct caches. This raises the challenge of Multisite Transactional Causal Consistency (MTCC): the ability to provide causal consistency for all I/Os within a given transaction even if it runs across multiple physical sites. We present protocols for MTCC implemented in a system called HYDROCACHE. Our evaluation demonstrates orders-of-magnitude performance improvements due to caching, while also protecting against consistency anomalies that otherwise arise frequently.

Supplementary Material

MP4 File (3318464.3389710.mp4)

Presentation Video

Download
107.33 MB

References

[1]

D. D. Akkoorath, A. Z. Tomsic, M. Bravo, Z. Li, T. Crain, A. Bieniusa, N. Preguicc a, and M. Shapiro. Cure: Strong semantics meets high availability and low latency. In 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS), pages 405--414. IEEE, 2016.

[2]

I. E. Akkus, R. Chen, I. Rimac, M. Stein, K. Satzke, A. Beck, P. Aditya, and V. Hilt. SAND: Towards high-performance serverless computing. In 2018 USENIX Annual Technical Conference (USENIX ATC 18), pages 923--935, 2018.

Digital Library

[3]

S. Almeida, J. a. Leit ao, and L. Rodrigues. Chainreaction: A causal

[4]

consistent datastore based on chain replication. In Proceedings of the 8th ACM European Conference on Computer Systems, EuroSys '13, pages 85--98, New York, NY, USA, 2013. ACM.

[5]

Aws Lambda - case studies. https://aws.amazon.com/lambda/resources/customer-case-studies/.

[6]

P. Bailis, A. Davidson, A. Fekete, A. Ghodsi, J. M. Hellerstein, and I. Stoica. Highly available transactions: Virtues and limitations. Proceedings of the VLDB Endowment, 7(3):181--192, 2013.

Digital Library

[7]

P. Bailis, A. Fekete, A. Ghodsi, J. M. Hellerstein, and I. Stoica. The potential dangers of causal consistency and an explicit solution. In Proceedings of the Third ACM Symposium on Cloud Computing, page 22. ACM, 2012.

[8]

P. Bailis, A. Ghodsi, J. M. Hellerstein, and I. Stoica. Bolt-on causal consistency. In Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13, pages 761--772, New York, NY, USA, 2013. ACM.

Digital Library

[9]

B. F. Cooper, R. Ramakrishnan, U. Srivastava, A. Silberstein, P. Bohannon, H.-A. Jacobsen, N. Puz, D. Weaver, and R. Yerneni. Pnuts: Yahoo!'s hosted data serving platform. Proc. VLDB Endow., 1(2):1277--1288, Aug. 2008.

Digital Library

[10]

J. C. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, and et al. Spanner: Google's globally distributed database. ACM Trans. Comput. Syst., 31(3), Aug. 2013.

Digital Library

[11]

J. Du, S. Elnikety, A. Roy, and W. Zwaenepoel. Orbe: Scalable causal consistency using dependency matrices and physical clocks. In Proceedings of the 4th Annual Symposium on Cloud Computing, SOCC '13, pages 11:1--11:14, New York, NY, USA, 2013. ACM.

Digital Library

[12]

J. Du, C. Iorgulescu, A. Roy, and W. Zwaenepoel. GentleRain: Cheap and scalable causal consistency with physical clocks. In Proceedings of the ACM Symposium on Cloud Computing, pages 1--13. ACM, 2014.

Digital Library

[13]

F. Fu, L. Liu, and L. Wang. Empirical analysis of online social networks in the age of web 2.0. Physica A: Statistical Mechanics and its Applications, 387:675--684, 01 2008.

[14]

J. M. Hellerstein, J. M. Faleiro, J. Gonzalez, J. Schleier-Smith, V. Sreekanti, A. Tumanov, and C. Wu. Serverless computing: One step forward, two steps back. In CIDR 2019, 9th Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 13--16, 2019, Online Proceedings, 2019.

[15]

S. Hendrickson, S. Sturdevant, T. Harter, V. Venkataramani, A. C. Arpaci-Dusseau, and R. H. Arpaci-Dusseau. Serverless computation with OpenLambda. In 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 16), Denver, CO, 2016. USENIX Association.

Digital Library

[16]

E. Jonas, J. Schleier-Smith, V. Sreekanti, C.-C. Tsai, A. Khandelwal, Q. Pu, V. Shankar, J. Menezes Carreira, K. Krauth, N. Yadwadkar, J. Gonzalez, R. A. Popa, I. Stoica, and D. A. Patterson. Cloud programming simplified: A Berkeley view on serverless computing. Technical Report UCB/EECS-2019--3, EECS Department, University of California, Berkeley, Feb 2019.

[17]

R. Ladin, B. Liskov, L. Shrira, and S. Ghemawat. Providing high availability using lazy replication. ACM Trans. Comput. Syst., 10(4):360--391, Nov. 1992.

Digital Library

[18]

Common lambda application types and use cases. https://docs.aws.amazon.com/lambda/latest/dg/applications-usecases.html.

[19]

L. Lamport. Time, clocks, and the ordering of events in a distributed system. Commun. ACM, 21(7):558--565, July 1978.

Digital Library

[20]

W. Lloyd, M. Freedman, M. Kaminsky, and D. G. Andersen. Don't settle for eventual: Scalable causal consistency for wide-area storage with cops. In SOSP'11 - Proceedings of the 23rd ACM Symposium on Operating Systems Principles, pages 401--416, 10 2011.

Digital Library

[21]

W. Lloyd, M. J. Freedman, M. Kaminsky, and D. G. Andersen. Stronger semantics for low-latency geo-replicated storage. In Presented as part of the 10th $$USENIX$$ Symposium on Networked Systems Design and Implementation ($$NSDI$$ 13), pages 313--328, 2013.

[22]

P. Mahajan, L. Alvisi, and M. Dahlin. Consistency, availability, convergence. Technical Report TR-11--22, Computer Science Department, University of Texas at Austin, May 2011.

[23]

S. A. Mehdi, C. Littley, N. Crooks, L. Alvisi, N. Bronson, and W. Lloyd. I cantextquoterightt believe ittextquoterights not causal! scalable causal consistency with no slowdown cascades. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), pages 453--468, Boston, MA, Mar. 2017. USENIX Association.

[24]

E. Oakes, L. Yang, D. Zhou, K. Houck, T. Harter, A. Arpaci-Dusseau, and R. Arpaci-Dusseau. SOCK: Rapid task provisioning with serverless-optimized containers. In 2018 USENIX Annual Technical Conference (USENIX ATC 18), pages 57--70, Boston, MA, 2018. USENIX Association.

Digital Library

[25]

R. Pang, R. Caceres, M. Burrows, Z. Chen, P. Dave, N. Germer, A. Golynski, K. Graney, N. Kang, L. Kissner, J. L. Korn, A. Parmar, C. D. Richards, and M. Wang. Zanzibar: Googletextquoterights consistent, global authorization system. In 2019 USENIX Annual Technical Conference (USENIX ATC 19), pages 33--46, Renton, WA, July 2019. USENIX Association.

[26]

T. Rabl, S. Gómez-Villamor, M. Sadoghi, V. Muntés-Mulero, H.-A. Jacobsen, and S. Mankovskii. Solving big data challenges for enterprise application performance management. Proc. VLDB Endow., 5(12):1724--1735, Aug. 2012.

Digital Library

[27]

M. Raynal and M. Singhal. Logical time: Capturing causality in distributed systems. Computer, 29(2):49--56, Feb. 1996.

Digital Library

[28]

Amazon aurora serverless. https://aws.amazon.com/rds/aurora/serverless/.

[29]

M. Shahrad, J. Balkind, and D. Wentzlaff. Architectural implications of function-as-a-service computing. In Proceedings of the 52Nd Annual IEEE/ACM International Symposium on Microarchitecture, MICRO '52, pages 1063--1075, New York, NY, USA, 2019. ACM.

Digital Library

[30]

M. Singhal and A. Kshemkalyani. An efficient implementation of vector clocks. Inf. Process. Lett., 43(1):47--52, Aug. 1992.

Digital Library

[31]

V. Sreekanti, C. Wu, X. C. Lin, J. Schleier-Smith, J. M. Faleiro, J. Gonzalez, J. M. Hellerstein, and A. Tumanov. Cloudburst: Stateful functions-as-a-service. ArXiv, abs/2001.04592, 2020.

Digital Library

[32]

C. Wu, J. Faleiro, Y. Lin, and J. Hellerstein. Anna: A kvs for any scale. IEEE Transactions on Knowledge and Data Engineering, 2019.

Digital Library

[33]

C. Wu, V. Sreekanti, and J. M. Hellerstein. Autoscaling tiered cloud storage in anna. Proceedings of the VLDB Endowment, 12(6):624--638, 2019.

Digital Library

[34]

M. Zawirski, N. Preguicca, S. Duarte, A. Bieniusa, V. Balegas, and M. Shapiro. Write fast, read in the past: Causal consistency for client-side applications. In Proceedings of the 16th Annual Middleware Conference, Middleware '15, pages 75--87, New York, NY, USA, 2015. ACM.

Digital Library

Cited By

Nikolic LDimitrieski VCelikovic M(2024)An approach for supporting transparent acid transactions over heterogeneous data stores in microservice architecturesComputer Science and Information Systems10.2298/CSIS221210006N21:1(167-202)Online publication date: 2024
https://doi.org/10.2298/CSIS221210006N
Li QKraft P(2024)Transactions and Serverless are Made for Each OtherCommunications of the ACM10.1145/3690930Online publication date: 20-Nov-2024
https://doi.org/10.1145/3690930
Li QKraft P(2024)Transactions and Serverless are Made for Each OtherQueue10.1145/367495222:3(79-91)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3674952
Show More Cited By

Index Terms

Transactional Causal Consistency for Serverless Computing
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
      1. Cloud computing
2. Information systems
  1. Data management systems
    1. Database management system engines
      1. Distributed database transactions
      2. Parallel and distributed DBMSs
  2. Information storage systems
    1. Storage architectures
      1. Cloud based storage

Recommendations

Supporting Multi-Provider Serverless Computing on the Edge
ICPP Workshops '18: Workshop Proceedings of the 47th International Conference on Parallel Processing

Serverless computing has recently emerged as a new execution model for cloud computing, in which service providers offer compute runtimes, also known as Function-as-a-Service (FaaS) platforms, allowing users to develop, execute and manage application ...
Causal consistency: beyond memory
PPoPP '16

In distributed systems where strong consistency is costly when not impossible, causal consistency provides a valuable abstraction to represent program executions as partial orders. In addition to the sequential program order of each computing entity, ...
Causal consistency: beyond memory
PPoPP '16: Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming

In distributed systems where strong consistency is costly when not impossible, causal consistency provides a valuable abstraction to represent program executions as partial orders. In addition to the sequential program order of each computing entity, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '20: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data

June 2020

2925 pages

ISBN:9781450367356

DOI:10.1145/3318464

General Chairs:
David Maier
Portland State University, USA
,
Rachel Pottinger
University of British Columbia, Canada
,
Program Chairs:
AnHai Doan
University of Wisconsin, USA
,
Wang-Chiew Tan
Megagon Labs, USA
,
Publications Chairs:
Abdussalam Alawini
University of Illinois at Urbana-Champaign, USA
,
Hung Q. Ngo
RelationalAI, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 May 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

SIGMOD/PODS '20

Sponsor:

SIGMOD

SIGMOD/PODS '20: International Conference on Management of Data

June 14 - 19, 2020

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
3,244
Total Downloads

Downloads (Last 12 months)578
Downloads (Last 6 weeks)84

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nikolic LDimitrieski VCelikovic M(2024)An approach for supporting transparent acid transactions over heterogeneous data stores in microservice architecturesComputer Science and Information Systems10.2298/CSIS221210006N21:1(167-202)Online publication date: 2024
https://doi.org/10.2298/CSIS221210006N
Li QKraft P(2024)Transactions and Serverless are Made for Each OtherCommunications of the ACM10.1145/3690930Online publication date: 20-Nov-2024
https://doi.org/10.1145/3690930
Li QKraft P(2024)Transactions and Serverless are Made for Each OtherQueue10.1145/367495222:3(79-91)Online publication date: 5-Jul-2024
https://dl.acm.org/doi/10.1145/3674952
Pereira PSilva A(2024)Microservices simulator: An object-oriented framework for transactional causal consistencyScience of Computer Programming10.1016/j.scico.2024.103181(103181)Online publication date: Jul-2024
https://doi.org/10.1016/j.scico.2024.103181
Ghorbian MGhobaei-Arani MEsmaeili L(2024)A survey on the scheduling mechanisms in serverless computing: a taxonomy, challenges, and trendsCluster Computing10.1007/s10586-023-04264-827:5(5571-5610)Online publication date: 18-Feb-2024
https://doi.org/10.1007/s10586-023-04264-8
Li BLi ZLuo JTan YLu P(2023)µFuncCache: A User-Side Lightweight Cache System for Public FaaS PlatformsElectronics10.3390/electronics1212264912:12(2649)Online publication date: 13-Jun-2023
https://doi.org/10.3390/electronics12122649
Bouizem YDib DParlavantzas NMorin C(2023)Integrating request replication into FaaS platforms: an experimental evaluationJournal of Cloud Computing10.1186/s13677-023-00457-z12:1Online publication date: 22-Jun-2023
https://doi.org/10.1186/s13677-023-00457-z
Basu Roy RPatel TLiew RBabuji YChard RTiwari DButt AMi NChard K(2023)ProPack: Executing Concurrent Serverless Functions Faster and CheaperProceedings of the 32nd International Symposium on High-Performance Parallel and Distributed Computing10.1145/3588195.3592988(211-224)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3588195.3592988
Wen JChen ZJin XLiu X(2023)Rise of the Planet of Serverless Computing: A Systematic ReviewACM Transactions on Software Engineering and Methodology10.1145/357964332:5(1-61)Online publication date: 21-Jul-2023
https://dl.acm.org/doi/10.1145/3579643
Li YLin YWang YYe KXu C(2023)Serverless Computing: State-of-the-Art, Challenges and OpportunitiesIEEE Transactions on Services Computing10.1109/TSC.2022.316655316:2(1522-1539)Online publication date: 1-Mar-2023
https://doi.org/10.1109/TSC.2022.3166553
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents