More Web Proxy on the site http://driver.im/

research-article

Whitening SOA testing

Authors:

Cesare Bartolini,

Antonia Bertolino,

Sebastian Elbaum,

Eda MarchettiAuthors Info & Claims

ESEC/FSE '09: Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering

Pages 161 - 170

https://doi.org/10.1145/1595696.1595721

Published: 24 August 2009 Publication History

Abstract

Service Oriented Architectures (SOAs) are becoming increasingly popular and powerful. Fueling that growth is the availability of independent web services that can be cost-effectively composed with other services to provide richer functionality. The reasons that make these systems easier to build, however, also make them more challenging to test. Independent web services usually provide just an interface, enough to invoke them and develop some general (black-box) tests, but insufficient for a tester to develop an adequate understanding of the integration quality between the application and independent web services. To address this lack we propose a "whitening" approach to make web services more transparent through the addition of an intermediate coverage service. The approach, named Service Oriented Coverage Testing (SOCT), provides a tester with feedback about how a whitened service, called a Testable Service, is exercised. In this paper we introduce the SOCT approach, implement an instance of it, and perform a preliminary study to show its feasibility and potential value. SOCT enables SOA white-box testing, while maintaining SOA flexibility, dynamism and loose coupling.

References

[1]

DIstributed colLaboratories Infrastructure on Grid ENabled Technology 4 Science. http://www.d4science.eu/.

[2]

Amazon Discussion Forum. Thread: Massive (500) Internal Server Error.outage. http://developer.amazonwebservices.com/connect/thread.jspa?threadID=19714.

[3]

C. Bartolini, A. Bertolino, and E. Marchetti. Introducing service-oriented coverage testing. In Workshop on Automated engineeRing of Autonomous and run-tiMe evolvIng Systems, pages 57--64, 2008.

Digital Library

[4]

C. Bartolini, A. Bertolino, E. Marchetti, and I. Parissis. Data Flow-Based Validation of Web Services Compositions: Perspectives and Examples, pages 298--325. Architecting Dependable Systems V. Springer-Verlag, 2008.

Digital Library

[5]

A. Benharref, R. Dssouli, M. A. Serhani, and R. Glitho. Efficient traces' collection mechanisms for passive testing of web services. Information Software Technology Journal, 51(2):362--374, 2009.

Digital Library

[6]

A. Bertolino, J. Gao, E. Marchetti, and A. Polini. Systematic generation of XML instances to test complex software applications. In Rapid Integration in Software Engineering. LNCS 4401, September 2006. Geneve, Switzerland.

Digital Library

[7]

A. Bertolino and A. Polini. SOA test governance: enabling service integration testing across organization and technology borders. In Workshop on Web Testing, pages 277--286, 2009.

Digital Library

[8]

A. Bucchiarone, H. Melgratti, and F. Severoni. Testing service composition. In Argentine Symposium on Software Engineering, 2007.

[9]

G. Canfora and M. Di Penta. Service Oriented Architecture Testing : A Survey, pages 78--105. Number 5413 in LNCS. Springer, 2009.

Digital Library

[10]

H. Cao, S. Ying, and D. Du. Towards model-based verification of BPEL with model checking. In International Conference on Computer and Information Technology, pages 190--194, 2006.

Digital Library

[11]

M. Di Penta, G. Canfora, G. Esposito, V. Mazza, and M. Bruno. Search-based testing of service level agreements. In Conference on Genetic and Evolutionary Computation, pages 1090--1097, 2007.

Digital Library

[12]

M. Fisher II, S. Elbaum, and G. Rothermel. Automated refinement and augmentation of web service description files. Technical Report 0026, University of Nebraska, Lincoln, Computer Science and Engineering Department, December 2007.

[13]

M. Fisher II, S. Elbaum, and G. Rothermel. Dynamic characterization of web application interfaces. In M. B. Dwyer and A. Lopes, editors, Fundamental Approaches to Software Engineering, volume 4422 of Lecture Notes in Computer Science, pages 260--275. Springer, 2007.

Digital Library

[14]

J. García-Fanjul, J. Tuya, and C. de la Riva. Generating test cases specifications for BPEL compositions of web services using SPIN. In International Workshop on Web Services Modeling and Testing, 2006.

[15]

Gartner and Forrester: Use of Web services skyrocketing, 2003. www.utilitycomputing.com/news/404.asp.

[16]

Health Level Seven. http://www.hl7.org/, accessed Oct. 9, 2008.

[17]

Z. J. Li, H. F. Tan, H. H. Liu, J. Zhu, and N. M. Mitsumori. Business-process-driven gray-box soa testing. IBM Syst. J., 47(3):457--472, 2008.

Digital Library

[18]

H. Lu, W. Chan, and T. Tse. Testing context-aware middleware-centric programs: a data flow approach and an RFID-based experimentation. Symposium on Foundations of Software Engineering, pages 242--252, 2006.

Digital Library

[19]

L. Mei, W. Chan, and T. Tse. Data Flow Testing of Service-Oriented Workflow Applications. In TestCom 2008, volume 5047 of LNCS, pages 371--380. Springer, 2008.

Digital Library

[20]

OASIS Reference Model for Service Oriented Architecture 1.0, Official OASIS Standard, Oct. 12, 2006. http://www.oasis-open.org.

[21]

OASIS WSBPEL Technical Committee. Web services business process execution language version 2.0. http://docs.oasis-open.org/wsbpel/2.0/wsbpel-v2.0.pdf, 2007.

[22]

M. Pascale, M. Roselli, U. Rugani, C. Bartolini, A. Bertolino, F. Lonetti, E. Marchetti, and A. Polini. Automated testing of healthcare document transformations in the PICASSO interoperability platform. In Software Engineering in Practice, 2009.

[23]

M. Pezzè and M. Young. Software Testing and Analysis: Process, Principles and Techniques. Wiley, 2007.

Digital Library

[24]

PLASTIC Validation Framework Tools homepage. http://plastic.isti.cnr.it/wiki/doku.php/tools.

[25]

A. Sinha and A. Paradkar. Model-based functional conformance testing of web services operating on persistent data. In Workshop on Testing, analysis, and verification of web services and applications, pages 17--22, 2006.

Digital Library

[26]

Torry Harris Business Solutions. White Paper. SOA test methodology.

[27]

W. Xu, J. Offutt, and J. Luo. Testing web services by xml perturbation. In International Symposium on Software Reliability Engineering, pages 257--266, 2005.

Digital Library

[28]

J. Yan, Z. Li, Y. Yuan, W. Sun, and J. Zhang. BPEL4WS unit testing: Test case generation using a concurrent path analysis approach. In International Symposium on Software Reliability Engineering, pages 75--84, 2006.

Digital Library

[29]

Y. Yuan, Z. Li, and W. Sun. A graph-search based approach to BPEL4WS test generation. In International Conference on Software Engineering Advances, 2006.

Digital Library

Cited By

Sun CDai HWang GTowey DChen TCai K(2022)Dynamic Random Testing of Web Services: A Methodology and EvaluationIEEE Transactions on Services Computing10.1109/TSC.2019.296049615:2(736-751)Online publication date: 1-Mar-2022
https://doi.org/10.1109/TSC.2019.2960496
Cioroaica EDaoudagh SMarchetti E(2022)Predictive Simulation for Building Trust Within Service-Based Ecosystems2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops53856.2022.9767457(34-37)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerComWorkshops53856.2022.9767457
Zahid MAkhtar AShafiq BShamail SAfzal AVaidya J(2022)An Integrated Framework for Fault Resolution in Business Processes2022 IEEE International Conference on Web Services (ICWS)10.1109/ICWS55610.2022.00048(266-275)Online publication date: Jul-2022
https://doi.org/10.1109/ICWS55610.2022.00048
Show More Cited By

Index Terms

Whitening SOA testing
1. Information systems
  1. World Wide Web
    1. Web applications
    2. Web services
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Bringing white-box testing to Service Oriented Architectures through a Service Oriented Approach

The attractive feature of Service Oriented Architecture (SOA) is that pieces of software conceived and developed by independent organizations can be dynamically composed to provide richer functionality. The same reasons that enable flexible compositions,...
Whitening SOA Testing via Event Exposure

Whitening the testing of service-oriented applications can provide service consumers confidence on how well an application has been tested. However, to protect business interests of service providers and to prevent information leakage, the ...
Service-oriented architecture (SOA)concepts and implementations
SIGAda '11: Proceedings of the 2011 ACM annual international conference on Special interest group on the ada programming language

This tutorial explains how to implement a Service-Oriented Architecture (SOA) for reliable systems using Enterprise Service Bus (ESB) technologies. The first half of the tutorial describes terms of Service-Oriented Architectures (SOA) including service, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ESEC/FSE '09: Proceedings of the 7th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering

August 2009

408 pages

ISBN:9781605580012

DOI:10.1145/1595696

General Chair:
Hans van Vliet
VU University Amsterdam, The Netherlands
,
Program Chair:
Valerie Issarny
INRIA-Paris-Rocquencourt, France

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEC/FSE09

Sponsor:

ESEC/FSE09: Joint 12th European Software Engineering Conference

August 24 - 28, 2009

Amsterdam, The Netherlands

Acceptance Rates

ESEC/FSE '09 Paper Acceptance Rate 32 of 217 submissions, 15%;

Overall Acceptance Rate 112 of 543 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,008
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sun CDai HWang GTowey DChen TCai K(2022)Dynamic Random Testing of Web Services: A Methodology and EvaluationIEEE Transactions on Services Computing10.1109/TSC.2019.296049615:2(736-751)Online publication date: 1-Mar-2022
https://doi.org/10.1109/TSC.2019.2960496
Cioroaica EDaoudagh SMarchetti E(2022)Predictive Simulation for Building Trust Within Service-Based Ecosystems2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops)10.1109/PerComWorkshops53856.2022.9767457(34-37)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerComWorkshops53856.2022.9767457
Zahid MAkhtar AShafiq BShamail SAfzal AVaidya J(2022)An Integrated Framework for Fault Resolution in Business Processes2022 IEEE International Conference on Web Services (ICWS)10.1109/ICWS55610.2022.00048(266-275)Online publication date: Jul-2022
https://doi.org/10.1109/ICWS55610.2022.00048
Gao HDuan YShao LSun X(2021)Transformation-based processing of typed resources for multimedia sources in the IoT environmentWireless Networks10.1007/s11276-019-02200-627:5(3377-3393)Online publication date: 1-Jul-2021
https://dl.acm.org/doi/10.1007/s11276-019-02200-6
Miranda BBertolino A(2018)An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testingSoftware Quality Journal10.1007/s11219-017-9388-026:4(1571-1594)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s11219-017-9388-0
Ohmann PBrown DNeelakandan NLinderoth JLiblit BLo DApel SKhurshid S(2016)Optimizing customized program coverageProceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering10.1145/2970276.2970351(27-38)Online publication date: 25-Aug-2016
https://dl.acm.org/doi/10.1145/2970276.2970351
Miranda BBertolino ABudnik CFraser GLonetti F(2016)Does code coverage provide a good stopping rule for operational profile based testing?Proceedings of the 11th International Workshop on Automation of Software Test10.1145/2896921.2896934(22-28)Online publication date: 14-May-2016
https://dl.acm.org/doi/10.1145/2896921.2896934
Besson FMoura PKon FMilojicic D(2015)Bringing Test-Driven Development to web service choreographiesJournal of Systems and Software10.1016/j.jss.2014.09.03499:C(135-154)Online publication date: 1-Jan-2015
https://dl.acm.org/doi/10.1016/j.jss.2014.09.034
Miranda BCrnkovic IChechik MGrünbacher P(2014)A proposal for revisiting coverage testing metricsProceedings of the 29th ACM/IEEE International Conference on Automated Software Engineering10.1145/2642937.2653471(899-902)Online publication date: 15-Sep-2014
https://dl.acm.org/doi/10.1145/2642937.2653471
Miranda BBertolino AZhu HGao JSinha SZhang L(2014)Social coverage for customized test adequacy and selection criteriaProceedings of the 9th International Workshop on Automation of Software Test10.1145/2593501.2593505(22-28)Online publication date: 31-May-2014
https://dl.acm.org/doi/10.1145/2593501.2593505
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents