More Web Proxy on the site http://driver.im/

Article

A case study of automatically creating test suites from web application field data

Authors:

Sreedevi Sampath,

Lori PollockAuthors Info & Claims

TAV-WEB '06: Proceedings of the 2006 workshop on Testing, analysis, and verification of web services and applications

Pages 1 - 9

https://doi.org/10.1145/1145718.1145719

Published: 17 July 2006 Publication History

Abstract

Creating effective test cases is a difficult problem, especially for web applications. To comprehensively test a web application's functionality, test cases must test complex application state dependencies and concurrent user interactions. Rather than creating test cases manually or from a static model, field data provides an inexpensive alternative to creating such sophisticated test cases. An existing approach to using field data in testing web applications is user-session-based testing. Previous user-session-based testing approaches ignore state dependences from multi-user interactions. In this paper, we propose strategies for leveraging web application field data to automatically create test cases that test various levels of multi-user interaction and state dependencies. Results from out preliminary case study of a publicly deployed web application show that these test case creation mechanisms are a promising testing strategy for web applications.

References

[1]

A. Andrews, J. Offutt, and R. Alexander. Testing web applications by modeling with FSMs. Software Systems and Modeling, 4(2), Apr. 2005.

[2]

R. Binder. Testing Object-Oriented Systems. Addison Wesley, 2000.

Digital Library

[3]

Clover: Code coverage tool for Java. <http://www.cenqua.com/clover/>, 2006.

[4]

G. DiLucca, A. Fasolino, F. Faralli, and U. D. Carlini. Testing web applications. In International Conference on Software Maintenance, page 310--319, Oct. 2002.

Digital Library

[5]

DSpace Federation. <http://www.dspace.org/>, 2006.

[6]

S. Elbaum, S. Karre, and G. Rothermel. Improving web application testing with user session data. In Proceedings of the 25th International Conference on Software Engineering, pages 49--59, 2003.

Digital Library

[7]

HTTPClient V0.3--3. <http://www.innovation.ch/java/HTTPClient/>, 2006.

[8]

B. Liblit, A. Aiken, A. X. Zheng, and M. I. Jordan. Bug isolation via remote program sampling. In Proceedings of the ACM SIGPLAN 2003 Conference on Programming Language Design and Implementation, pages 141--154, 2003.

Digital Library

[9]

C.-H. Liu, D. C. Kung, and P. Hsia. Object-based data flow testing of web applications. In First Asia-Pacific Conference on Quality Software, 2000.

Digital Library

[10]

Michal Blumenstyk. Web Application Development Bridging the Gap between QA and Development. <http://www.stickyminds.com>, 2002.

[11]

J. Offutt, Y. Wu, X. Du, and H. Huang. Bypass testing of web applications. In IEEE 15th International Symposium on Software Reliability Engineering, pages 187--197, Nov. 2004.

Digital Library

[12]

A. Orso and B. Kennedy. Selective capture and replay of program executions. In Proceedings of the Third International Workshop on Dynamic Analysis, May 2005.

Digital Library

[13]

S. Pertet and P. Narsimhan. Causes of failures in web applications. Technical Report CMU-PDL-05-109, Carnegie Mellon University, Dec. 2005.

[14]

F. Ricca and P. Tonella. Analysis and testing of web applications. In Proceedings of the 23rd International Conference on Software Engineering, pages 25--34, May 2001.

Digital Library

[15]

S. Sprenkle, E. Gibson, S. Sampath, and L. Pollock. Automated replay and fault detection for web applications. In Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering, pages 253--262, Nov. 2005.

Digital Library

[16]

S. Sprenkle, S. Sampath, E. Gibson, L. Pollock, and A. Souter. An empirical comparison of test suite reduction techniques for user-session-based testing of web applications. In Proceedings of the International Conference on Software Maintenance, pages 587--596, Sep. 2005.

Digital Library

Cited By

Maung HWin K(2015)Entropy Based Test Cases Reduction Algorithm for User Session Based TestingGenetic and Evolutionary Computing10.1007/978-3-319-23207-2_37(365-373)Online publication date: 4-Sep-2015
https://doi.org/10.1007/978-3-319-23207-2_37
Sprenkle SPollock LSimko L(2013)Configuring effective navigation models and abstract test cases for web applications by analysing user behaviourSoftware Testing, Verification and Reliability10.1002/stvr.149623:6(439-464)Online publication date: 29-Apr-2013
https://doi.org/10.1002/stvr.1496
Sprenkle SCobb CPollock L(2012)Leveraging User-Privilege Classification to Customize Usage-based Statistical Models of Web ApplicationsProceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation10.1109/ICST.2012.96(161-170)Online publication date: 17-Apr-2012
https://dl.acm.org/doi/10.1109/ICST.2012.96
Show More Cited By

Index Terms

A case study of automatically creating test suites from web application field data

Recommendations

Prioritizing random combinatorial test suites
SAC '17: Proceedings of the Symposium on Applied Computing

The behaviour of a system under test can be influenced by several factors, such as system configurations, user inputs, and so on. It has also been observed that many failures are caused by only a small number of factors. Combinatorial testing aims at ...
Compressing Automatically Generated Unit Test Suites Through Test Parameterization
Fundamentals of Software Engineering
Abstract
Test maintenance has recently gained increasing attention from the software testing research community. When using automated unit test generation tools, the tests are typically created by random test generation or search-based algorithms. Although ...
Evaluating String Distance Metrics for Reducing Automatically Generated Test Suites
AST '24: Proceedings of the 5th ACM/IEEE International Conference on Automation of Software Test (AST 2024)

Regression test suites can have a large number of test cases, especially automatically generated ones, and tend to grow in size, making it costly to run the entire test suite. Test suite reduction aims to eliminate some test cases to reduce the test ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

TAV-WEB '06: Proceedings of the 2006 workshop on Testing, analysis, and verification of web services and applications

July 2006

47 pages

ISBN:1595934588

DOI:10.1145/1145718

Conference Chair:
Tevfik Bultan
University of California, Santa Barbara

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 July 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

ISSTA06

ISSTA06: International Symposium on Software Testing and Analysis 2006

July 17, 2006

Maine, Portland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
834
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Maung HWin K(2015)Entropy Based Test Cases Reduction Algorithm for User Session Based TestingGenetic and Evolutionary Computing10.1007/978-3-319-23207-2_37(365-373)Online publication date: 4-Sep-2015
https://doi.org/10.1007/978-3-319-23207-2_37
Sprenkle SPollock LSimko L(2013)Configuring effective navigation models and abstract test cases for web applications by analysing user behaviourSoftware Testing, Verification and Reliability10.1002/stvr.149623:6(439-464)Online publication date: 29-Apr-2013
https://doi.org/10.1002/stvr.1496
Sprenkle SCobb CPollock L(2012)Leveraging User-Privilege Classification to Customize Usage-based Statistical Models of Web ApplicationsProceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation10.1109/ICST.2012.96(161-170)Online publication date: 17-Apr-2012
https://dl.acm.org/doi/10.1109/ICST.2012.96
Sprenkle SPollock LSimko L(2011)A Study of Usage-Based Navigation Models and Generated Abstract Test Cases for Web ApplicationsProceedings of the 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation10.1109/ICST.2011.34(230-239)Online publication date: 21-Mar-2011
https://dl.acm.org/doi/10.1109/ICST.2011.34
Sampath SBryce RJain SManchester S(2011)A tool for combination-based prioritization and reduction of user-session-based test suitesProceedings of the 2011 27th IEEE International Conference on Software Maintenance10.1109/ICSM.2011.6080833(574-577)Online publication date: 25-Sep-2011
https://dl.acm.org/doi/10.1109/ICSM.2011.6080833
Li JXing D(2011)User Session Data based Web Applications Test with Cluster AnalysisAdvanced Research on Computer Science and Information Engineering10.1007/978-3-642-21402-8_66(415-421)Online publication date: 2011
https://doi.org/10.1007/978-3-642-21402-8_66
Ying Huang Lu Lu (2010)A methodology for test suit reduction in user-session-based testing2010 IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA)10.1109/BICTA.2010.5645239(864-868)Online publication date: Sep-2010
https://doi.org/10.1109/BICTA.2010.5645239
Peng SGu QChen D(2009)Static Detection of Un-Trusted Variables in PHP Web Applications2009 International Conference on E-Business and Information System Security10.1109/EBISS.2009.5138078(1-5)Online publication date: May-2009
https://doi.org/10.1109/EBISS.2009.5138078
Sprenkle SEsquivel HHazelwood BPollock L(2008)WebVizOrProceedings of the Testing: Academic & Industrial Conference - Practice and Research Techniques10.1109/TAIC-PART.2008.19(89-93)Online publication date: 29-Aug-2008
https://dl.acm.org/doi/10.1109/TAIC-PART.2008.19
Marchetto A(2008)Talking about a Mutation-Based Reverse Engineering for Web TestingProceedings of the 2008 Sixth International Conference on Software Engineering Research, Management and Applications10.1109/SERA.2008.18(161-168)Online publication date: 20-Aug-2008
https://dl.acm.org/doi/10.1109/SERA.2008.18
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents