Abstract
In future Cloud ecosystems, brokers will mediate between service providers and consumers, playing an increased role in quality assurance, checking services for functional compliance to agreed standards, among other aspects. To date, most Software-as-a-Service (SaaS) testing has been performed manually, requiring duplicated effort at the development, certification and deployment stages of the service lifecycle. This paper presents a strategy for achieving automated testing for certification and re-certification of SaaS applications, based on the adoption of simple state-based and functional specifications. High-level test suites are generated from specifications, by algorithms that provide the necessary and sufficient coverage. The high-level tests must be grounded for each implementation technology, whether SOAP, REST or rich-client. Two examples of grounding are presented, one into SOAP for a traditional web service and the other into Selenium for a SAP HANA rich-client application. The results demonstrate good test coverage. Further work is required to fully automate the grounding.
Chapter PDF
Similar content being viewed by others
Keywords
References
Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility. Future Generation Computer Systems 25, 599–616 (2008)
Plummer, D.C., Lheureux, B.J., Karamouzis, F.: Defining Cloud Services Brokerage: Taking Intermediation to the Next Level. Report ID G00206187. Gartner, Inc. (2010)
Rao, L.: Using CloudKick to manage Amazon Webservices’ EC2. TechCrunch, http://techcrunch.com/2009/03/16/y-combinators-cloudkick-offers-simple-cloud-management-system/ (March 16, 2009)
Higginbotham, S.: Rightscale Makes Multiple Clouds Work. GigaOM, http://gigaom.com/2008/09/17/rightscale-makes-multiple-clouds-work/ (September 17, 2008)
Bozkurt, M., Harman, M., Hassoun, Y.: Testing & Verification in Service-Oriented Architecture: A Survey. Software Testing, Verification and Reliability 32(4), 261–313 (2012)
Bertolino, A., Frantzen, L., Polini, A., Tretmans, J.: Audition of Web Services for Testing Conformance to Open Specified Protocols. In: Reussner, R., Stafford, J.A., Szyperski, C. (eds.) Architecting Systems. LNCS, vol. 3938, pp. 1–25. Springer, Heidelberg (2006)
Heckel, R., Mariani, L.: Automatic Conformance Testing of Web Services. In: Cerioli, M. (ed.) FASE 2005. LNCS, vol. 3442, pp. 34–48. Springer, Heidelberg (2005)
Heckel, R., Lohmann, M.: Towards Contract-based Testing of Web Services. In: Proc. Int. Workshop on Test and Analysis of Component Based Systems, Barcelona, Spain. ENTCS, vol. 116, pp. 145–156 (2004)
Ramollari, E., Kourtesis, D., Dranidis, D., Simons, A.J.H.: Leveraging Semantic Web Service Descriptions for Validation by Automated Functional Testing. In: Aroyo, L., et al. (eds.) ESWC 2009. LNCS, vol. 5554, pp. 593–607. Springer, Heidelberg (2009)
Ma, C., Wu, J., Zhang, T., Zhang, Y., Cai, X.: Testing BPEL with Stream X-Machine. In: Proceedings of the 2008 International Symposium on Information Science and Engineering, pp. 578–582. IEEE Computer Society, Shanghai (2008)
Ramollari, E.: Automated Verification and Testing of Third-Party Web Services. PhD Thesis, Dept. of Computer Science, University of Sheffield, UK (2012)
Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann, Burlington (2007)
Pretschner, A., Philipps, J.: Methodological Issues in Model-Based Testing. In: Broy, M., Jonsson, B., Katoen, J.-P., Leucker, M., Pretschner, A. (eds.) Model-Based Testing of Reactive Systems. LNCS, vol. 3472, pp. 281–291. Springer, Heidelberg (2005)
Holcombe, W.M.L., Ipate, F.: Correct Systems - Building a Business Process Solution. Applied Computing Series. Springer, Berlin (1998)
El-Far, I.K., Whittaker, J.A.: Model-Based Software Testing. In: Marciniak, J.J. (ed.) Encyclopedia of Software Engineering. John Wiley & Sons, London (2002)
Laycock, G.: The Theory and Practice of Specification Based Software Testing. PhD Thesis. Dept. of Computer Science, University of Sheffield, UK (1993)
Ipate, F., Holcombe, W.M.L.: An integration testing method which is proved to find all faults. Int. J. Comp. Math. 63, 159–178 (1997)
Marchetto, A., Tonella, P., Ricca, F.: State-Based Testing of Ajax Web Applications. In: Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation, pp. 121–130. IEEE Computer Society Press, Washington, DC (2008)
Mesbah, A., van Deursen, A., Roest, D.: Invariant-Based Automatic Testing of Modern Web Applications. IEEE Trans. Software. Eng. 38(1), 35–53 (2012)
Selenium, H.Q.: Browser Automation, http://www.seleniumhq.org/
Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns - Elements of Reusable Object-Oriented Software. Addison-Wesley (1996)
KMI and SAP Research: Linked USDL, http://www.linked-usdl.org
Yang, Y., Onita, C., Dhaliwal, J., Zhang, X.: TESTQUAL: conceptualizing software testing as a service. In: Proc. 15th Americas Conf. on Information Systems, USA, paper 608 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kiran, M., Friesen, A., Simons, A.J.H., Schwach, W.K.R. (2014). Model-Based Testing in Cloud Brokerage Scenarios. In: Lomuscio, A.R., Nepal, S., Patrizi, F., Benatallah, B., Brandić, I. (eds) Service-Oriented Computing – ICSOC 2013 Workshops. ICSOC 2013. Lecture Notes in Computer Science, vol 8377. Springer, Cham. https://doi.org/10.1007/978-3-319-06859-6_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-06859-6_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-06858-9
Online ISBN: 978-3-319-06859-6
eBook Packages: Computer ScienceComputer Science (R0)