Abstract
This paper discusses the challenges in providing AI functionality “as a Service” (AIaaS) in enterprise contexts, and proposes solutions to some of these challenges. The solutions are based on our experience in designing, deploying, and testing AI services with a number of customers of ServiceNow, an Application Platform as a Service that enables digital workflows and simplifies the complexity of work in a single cloud platform. Some of the underlying ideas were developed when many of the authors were part of DxContinuum inc, a machine learning (ML) startup that ServiceNow bought in 2017 with the express purpose of embedding ML in the ServiceNow platform. The widespread adoption of ServiceNow by the majority of large corporations has given us the opportunity to interact with customers in different markets and to appreciate the needs, fears and barriers towards adopting AIaaS and to design solutions that respond to such barriers. In this paper we share the lessons we learned from these interactions and present the resulting framework and architecture we adopted, which aims at addressing fundamental concerns that are sometimes conflicting with each other, from automation to security, performance, effectiveness, ease of adoption, and efficient use of resources. Finally, we discuss the research challenges that lie ahead in this space.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
In this paper, we use the machine learning (ML) and artificial intelligence (AI) somewhat interchangeably because the distinction is not significant for the purposes of this paper.
- 2.
- 3.
The survey was run across regions and industries in the US, reaching over 2000 companies.
- 4.
See for example https://docs.uipath.com/orchestrator/docs/about-physical-deployment for RPA architectures on UIPath.
- 5.
- 6.
ServiceNow releases are named from cities around the world.
References
Amatriain, X., Basilico, J.: Netflix recommendations: Beyond the 5 stars. https://medium.com/netflix-techblog/netflix-recommendations-beyond-the-5-stars-part-1-55838468f429a (2012)
Augusto, A., et al.: Automated discovery of process models from event logs: review and benchmark. IEEE Trans. Knowl. Data Eng. PP, May 2017. https://doi.org/10.1109/TKDE.2018.2841877
Bouguettaya, A., et al.: A service computing manifesto: the next 10 years. Commun. ACM 60, 64–72 (2017). https://doi.org/10.1145/2983528
Brunet, M., Alkalay-Houlihan, C., Anderson, A., Zemel, R.S.: Understanding the origins of bias in word embeddings. CoRR abs/1810.03611 (2018). http://arxiv.org/abs/1810.03611
Di Francescomarino, C., Ghidini, C., Maggi, F., Milani, F.: Predictive process monitoring methods: which one suits me best?, April 2018
Geyer-Klingeberg, J., Nakladal, J., Baldauf, F., Veit, F.: Process mining and robotic process automation: a perfect match, July 2018
Grigori, D., Casati, F., Castellanos, M., Dayal, U., Sayal, M., Shan, M.C.: Business process intelligence. Comput. Ind. 53(3), 321–343 (2004). https://doi.org/10.1016/j.compind.2003.10.007
Hanzlik, L., et al.: MLCapsule: guarded offline deployment of machine learning as a service. Technical report, September 2018. https://arxiv.org/abs/1808.00590
Li, T., Zhong, J., Liu, J., Wu, W., Zhang, C.: Ease.ml: Towards multi-tenant resource sharing for machine learning workloads, September 2017
Mistry, S., Bouguettaya, A., Dong, H.: Economic Models for Managing Cloud Services. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73876-5
Osman, C., Ghiran, A.M.: Extracting customer traces from CRMS: from software to process models. Procedia Manufact. 32, 619–626 (2019). https://doi.org/10.1016/j.promfg.2019.02.261
Ribeiro, M., Grolinger, K., Capretz, M.: MLaaS: machine learning as a service, December 2015. https://doi.org/10.1109/ICMLA.2015.152
Sampson, A., Panchekha, P., Mytkowicz, T., McKinley, K.S., Grossman, D., Ceze, L.: Expressing and verifying probabilistic assertions. In: Programming Language Design and Implementation (PLDI), June 2014. https://www.microsoft.com/en-us/research/publication/expressing-and-verifying-probabilistic-assertions/
Sculley, D., et al.: Hidden technical debt in machine learning systems. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 28, pp. 2503–2511. Curran Associates, Inc. (2015). http://papers.nips.cc/paper/5656-hidden-technical-debt-in-machine-learning-systems.pdf
Seeliger, A., Nolle, T., Mühlhäuser, M.: Finding structure in the unstructured: hybrid feature set clustering for process discovery. In: Weske, M., Montali, M., Weber, I., vom Brocke, J. (eds.) BPM 2018. LNCS, vol. 11080, pp. 288–304. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98648-7_17
Seeliger, A., Sánchez Guinea, A., Nolle, T., Mühlhäuser, M.: ProcessExplorer: intelligent process mining guidance. In: Hildebrandt, T., van Dongen, B., Röglinger, M., Mendling, J. (eds.) BPM 2019. LNCS, vol. 11675. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-26619-6_15
Wang, W., et al.: Rafiki: machine learning as an analytics service system. Proc. VLDB Endowm. 12, 128–140 (2018). https://doi.org/10.14778/3282495.3282499
Webb, N.: Notes from the AI frontier: AI adoption advances, but foundational barriers remain (2018)
Yang, S., Li, J., Tang, X., Chen, S., Marsic, I., Burd, R.: Process mining for trauma resuscitation, vol. 18, August 2017
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Casati, F. et al. (2019). Operating Enterprise AI as a Service. In: Yangui, S., Bouassida Rodriguez, I., Drira, K., Tari, Z. (eds) Service-Oriented Computing. ICSOC 2019. Lecture Notes in Computer Science(), vol 11895. Springer, Cham. https://doi.org/10.1007/978-3-030-33702-5_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-33702-5_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33701-8
Online ISBN: 978-3-030-33702-5
eBook Packages: Computer ScienceComputer Science (R0)