More Web Proxy on the site http://driver.im/

article

Obstacles and opportunities in deploying model-based GUI testing of mobile software: a survey

Authors:

Tuula PääkkönenAuthors Info & Claims

Software Testing, Verification & Reliability, Volume 22, Issue 5

Pages 313 - 341

https://doi.org/10.1002/stvr.460

Published: 01 August 2012 Publication History

Abstract

Model-based testing has not been widely deployed in industry yet. There seem to be both technical and non-technical reasons for this situation. A survey among mobile software testing professions in Finland was conducted that aimed at investigating possible obstacles and opportunities towards wider deployment of this technology. This paper discusses the results and provides conclusions that indicate that at least in this context, there is much interest among practitioners towards the technology. However, more research is needed to make model creation and maintenance as easy as possible. In addition, metrics should be developed that can be used to report test results in the same manner as using existing testing techniques, enabling comparison between different approaches. Special emphasis should also be placed on enabling quick bug localization. Furthermore, it seems that successful pilot projects are a key to wider industrial adoption. Based on the survey findings, an agenda for the future model-based testing research is outlined. Copyright © 2011 John Wiley & Sons, Ltd.

(Model-based testing has not been widely deployed in the industry yet. A survey among mobile software testing professions in Finland was conducted that aimed at investigating the possible obstacles and opportunities towards the wider deployment of this technology. This paper discusses the results and provides the conclusions that indicate that at least in this context, there is much interest among practitioners towards the technology. Based on the survey findings, an agenda for the future model-based testing research is outlined.)

References

[1]

Utting M, Legeard B. Practical Model-Based Testing—A Tools Approach. Morgan Kaufmann: Los Altos, CA, 2007.

[2]

Nachmanson L, Schulte W, Tillmann N, Campbell C, Grieskamp W, Veanes M. Testing Concurrent Object-Oriented Systems with Spec Explorer (Lecture Notes in Computer Science, vol. 3582). Springer: Berlin, 2005; 542–547.

[3]

Fredriksson H. Experiences from using model based testing in general and with Qtronic in particular. Third MODPROD Workshop on Model-Based Product Development. Linköping University, Sweden, February 2009. Available at: {April 2011}.

[4]

Robinson H. Obstacles and opportunities for model-based testing in an industrial software environment. Proceedings of the First European Conference on Model-Driven Software Engineering, Nuremberg, Germany, December 2003; 118–127.

[5]

Hartman A. AGEDIS Project Final Report, 2004. Available at: {April 2011}.

[6]

Dias Neto A, Subramanyan R, Vieira M, Travassos GH, Shull F. Improving evidence about software technologies: A look at model-based testing. IEEE Software 2008; 25(3): 10–13.

[7]

Kaner C, Bach J, Pettichord B. Lessons Learned in Software Testing: A Context-Driven Approach. Wiley: New York, 2001.

[8]

Dias-Neto AC, Travassos GH. Model-based testing approaches selection for software projects. Information and Software Technology 2009; 51(11): 1487–1504.

[9]

Jääskeläinen A, Katara M, Kervinen A, Heiskanen H, Maunumaa M, Pääkkönen T. Model-based testing service on the web. Proceedings of the 20th IFIP International Conference on Testing of Communicating Systems and the Eighth International Workshop on Formal Approaches to Testing of Software (TESTCOM/FATES'08) (Lecture Notes in Computer Science, vol. 5047). Springer: Berlin, June 2008; 38–53.

[10]

Jääskeläinen A, Kervinen A, Katara M. Creating a test model library for GUI testing of smartphone applications. Proceedings of the Eighth International Conference on Quality Software (QSIQ'08) (short paper). IEEE Computer Society: Silver Spring, MD, August 2008; 276–282.

[11]

Takala T, Maunumaa M, Katara M. An adapter framework for keyword-driven testing. Proceedings of the Ninth International Conference on Quality Software (QSIQ'09). IEEE: New York, August 2009.

Digital Library

[12]

Jääskeläinen A, Katara M, Kervinen A, Maunumaa M, Pääkkönen T, Takala T, Virtanen H. Automatic GUI test generation for smart phone applications—An evaluation. Proceedings of the Software Engineering in Practice Track of the 31st International Conference on Software Engineering (ICSE'09), Companion Volume. IEEE Computer Society: Silver Spring, MD, 2009; 112–122.

[13]

S60HomePage. Available at: {April 2011}.

[14]

Jääskeläinen A, Takala T, Katara M. Model-based GUI testing of smartphone applications: Case S60 and Linux. Model-Based Testing for Embedded Systems, Zander J, Schieferdecker I, Mosterman PJ (eds). CRC Press: London, May 2011.

[15]

Jääskeläinen A, Takala T, Katara M. Model-based GUI testing of Android applications. Experiences of Test Automation, Graham D, Fewster M (eds), Addison-Wesley/Pearson Education, 2011; to appear.

[16]

Hartman A, Katara M, Olvovsky S. Choosing a test modeling language: A survey. Proceedings of the Haifa Verification Conference 2006 (Lecture Notes in Computer Science, vol. 4383). Springer: Berlin, 2007.

[17]

Buwalda H. Action figures. STQE Magazine 2003; 42–47.

[18]

Fewster M, Graham D. Software Test Automation: Effective Use of Test Execution Tools. Addison-Wesley: Reading, MA, 1999.

[19]

Nikkanen M. Use case based automatic user interface testing in mobile devices. Master's Thesis, Helsinki University of Technology, May 2005.

[20]

Symbio. A-Tool product description. Available at: {April 2011}.

[21]

Jääskeläinen A. A domain-specific tool for creation and management of test models. Master's Thesis, Tampere University of Technology, January 2008.

[22]

Eclipse foundation. Available at: {April 2011}.

[23]

Zakas NC, McPeak J, Fawcett J. Professional Ajax (2nd edn). Wiley: New York, 2007.

[24]

Barribeau P, Butler B, Corney J, Doney M, Gault J, Gordon J, Fetzer R, Klein A, Rogers CA, Stein IF, Steiner C, Urschel H, Waggoner T, Palmquist M. ‘Survey Research’. Writing@CSU. Colorado State University Department of English, 2005. Available at: {April 2011}.

[25]

Fowler FJ Jr. Survey Research Methods. Sage Publications, Inc.: London, 2002.

[26]

Likert R. A technique for the measurement of attitudes. Archives of Psychology 1932; 140: 1–55.

[27]

Del Siegle. ‘Likert Scale’. Neag School of Education—University of Connecticut. Available at: {April 2011}.

[28]

Wuensch KL. ‘What is a Likert Scale?’. Department of Psychology, East Carolina University, 2005. Available at: {April 2011}.

[29]

Pfleeger SL, Kitchenham BA. Principles of survey research: part 1: Turning lemons into lemonade. SIGSOFT Software Engineering Notes 2001; 26(6): 16–18.

[30]

Kujala S. Research methods: Surveys and interviews, 2007. Available at: {April 2011}.

[31]

Kitchenham B, Pfleeger SL. Principles of survey research. Part 5: Populations and samples. SIGSOFT Software Engineering Notes 2002; 27(5): 17–20.

[32]

Kitchenham B, Pfleeger SL. Principles of survey research. Part 4: Questionnaire evaluation. SIGSOFT Software Engineering Notes 2002; 27(3): 20–23.

[33]

ISEB. Information Systems Examination Board. Available at: {April 2011}.

[34]

ISTQB. International Software Testing Qualifications Board. Available at: {April 2011}.

[35]

Kitchenham B, Pfleeger SL. Principles of survey research. Part 6: Data analysis. SIGSOFT Software Engineering Notes 2003; 28(2): 24–27.

[36]

Fowler M. Continuous integration. Available at: {April 2011}.

[37]

Jääskeläinen A, Kervinen A, Katara M, Valmari A, Virtanen H. Synthesizing test models from test cases. Proceedings of the Fourth International Haifa Verification Conference on Hardware and Software: Verification and Testing (HVC'08) (Lecture Notes in Computer Science, vol. 5394). Springer: Berlin, May 2009; 179–193.

[38]

Jääskeläinen A. Filtering test models to support incremental testing. Proceedings of the Fifth Testing: Academic & Industrial Conference––Practice and Research Techniques (TAIC PART'10) (Lecture Notes in Computer Science, vol. 6303). Springer: Berlin, 2010.

Cited By

Alégroth EKarl KRosshagen HHelmfridsson TOlsson N(2022)Practitioners’ best practices to Adopt, Use or Abandon Model-based Testing with Graphical models for Software-intensive SystemsEmpirical Software Engineering10.1007/s10664-022-10145-227:5Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10664-022-10145-2
Junior NCosta HKarita LMachado ISoares L(2021)Experiences and Practices in GUI Functional Testing: A Software Practitioners’ ViewProceedings of the XXXV Brazilian Symposium on Software Engineering10.1145/3474624.3474640(195-204)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3474624.3474640
Garousi VKeleş ABalaman YGüler ZArcuri A(2021)Model-based testing in practiceJournal of Systems and Software10.1016/j.jss.2021.111032180:COnline publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1016/j.jss.2021.111032
Show More Cited By

Obstacles and opportunities in deploying model-based GUI testing of mobile software: a survey
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis

Recommendations

Lessons learned from making the transition to model-based GUI testing
A-TEST 2019: Proceedings of the 10th ACM SIGSOFT International Workshop on Automating TEST Case Design, Selection, and Evaluation

Model-based testing (MBT) has been proposed as an effective and versatile approach for testing graphical user interfaces (GUIs) by automatically generating executable test cases from a model of the GUI. Model-based GUI testing has received increasing ...
A survey on model-based testing approaches: a systematic review
WEASELTech '07: Proceedings of the 1st ACM international workshop on Empirical assessment of software engineering languages and technologies: held in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007

This paper describes a systematic review performed on model-based testing (MBT) approaches. A selection criterion was used to narrow the initially identified four hundred and six papers to focus on seventy-eight papers. Detailed analysis of these papers ...
Comparing model-based and dynamic event-extraction based GUI testing techniques

HighlightsWe compare model-based and dynamic event-extraction based GUI testing techniques.We present a exible GUI testing framework that enables comparison of techniques.We show that nonexecutable events weaken effectiveness and increase costs of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Software Testing, Verification & Reliability

Software Testing, Verification & Reliability Volume 22, Issue 5

August 2012

66 pages

ISSN:0960-0833

EISSN:1099-1689

Issue’s Table of Contents

Publisher

John Wiley and Sons Ltd.

United Kingdom

Publication History

Published: 01 August 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Alégroth EKarl KRosshagen HHelmfridsson TOlsson N(2022)Practitioners’ best practices to Adopt, Use or Abandon Model-based Testing with Graphical models for Software-intensive SystemsEmpirical Software Engineering10.1007/s10664-022-10145-227:5Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10664-022-10145-2
Junior NCosta HKarita LMachado ISoares L(2021)Experiences and Practices in GUI Functional Testing: A Software Practitioners’ ViewProceedings of the XXXV Brazilian Symposium on Software Engineering10.1145/3474624.3474640(195-204)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3474624.3474640
Garousi VKeleş ABalaman YGüler ZArcuri A(2021)Model-based testing in practiceJournal of Systems and Software10.1016/j.jss.2021.111032180:COnline publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1016/j.jss.2021.111032
Said KNie LAjibode AZhou X(2020)GUI testing for mobile applications: objectives, approaches and challengesProceedings of the 12th Asia-Pacific Symposium on Internetware10.1145/3457913.3457931(51-60)Online publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1145/3457913.3457931
Garousi VKeleş ABalaman YGüler Z(2020)Test Automation with the Gauge Framework: Experience and Best PracticesComputational Science and Its Applications – ICCSA 202010.1007/978-3-030-58802-1_33(458-470)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-58802-1_33
da Silva HMattiello GEndo Ade Souza Éde Souza S(2018)Evaluating the Impact of Different Testers on Model-based TestingProceedings of the III Brazilian Symposium on Systematic and Automated Software Testing10.1145/3266003.3266012(57-66)Online publication date: 17-Sep-2018
https://dl.acm.org/doi/10.1145/3266003.3266012
Ali AMaghawry HBadr N(2018)Automated parallel GUI testing as a service for mobile applicationsJournal of Software: Evolution and Process10.1002/smr.196330:10Online publication date: 17-Oct-2018
https://dl.acm.org/doi/10.1002/smr.1963
Metsä JMaoz SKatara MMikkonen T(2014)Using aspects for testing of embedded softwareSoftware Quality Journal10.1007/s11219-012-9193-822:2(185-213)Online publication date: 1-Jun-2014
https://dl.acm.org/doi/10.1007/s11219-012-9193-8

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents