ScoutDroid: A Tool For Mobile Augmented Testing with Live Feedback
Pages 34 - 37
Abstract
In the evolving landscape of mobile applications, effective and efficient testing methods are crucial for ensuring high-quality user experiences. This paper introduces a novel end-to-end mobile testing technique designed to enhance exploratory testing by incorporating gamification strategies. We developed a plugin that integrates these innovative techniques, aiming to make the testing process more engaging and effective. With the use of a live feedback system, the plugin drives testers to thoroughly explore the application, leading to the discovery of more defects and improved software quality. Preliminary evaluation suggests that this approach could not only increase tester engagement but also improve the detection rate of critical issues. This research highlights the potential of merging exploratory testing with gamification, setting the stage for more dynamic and productive mobile testing methodologies.
References
[1]
Wasif Afzal, Ahmad Nauman Ghazi, Juha Itkonen, Richard Torkar, Anneliese Andrews, and Khurram Bhatti. 2015. An experiment on the effectiveness and efficiency of exploratory testing. Empirical software engineering : an international journal, 20, 3 (2015), 844–878. issn:1382-3256
[2]
Appium. 2024. Appium - UiAutomator2 Driver. https://github.com/appium/appium-uiautomator2-driver
[3]
Yu-Kai Chou. 2023. The Octalysis Framework for Gamification & Behavioral Design. https://yukaichou.com/gamification-examples/octalysis-complete-gamification-framework/
[4]
Riccardo Coppola, Tommaso Fulcini, Luca Ardito, Marco Torchiano, and Emil Alègroth. 2024. On Effectiveness and Efficiency of Gamified Exploratory GUI Testing. IEEE Transactions on Software Engineering, 50, 2 (2024), 322–337. https://doi.org/10.1109/TSE.2023.3348036
[5]
Sebastian Deterding. 2012. Gamification: designing for motivation. Interactions, 19, 4 (2012), jul, 14–17. issn:1072-5520 https://doi.org/10.1145/2212877.2212883
[6]
Android Developers. 2024. Android runtime and Dalvik. https://source.android.com/docs/core/runtime
[7]
Mattia Fazzini, Eduardo Noronha De A. Freitas, Shauvik Roy Choudhary, and Alessandro Orso. 2017. Barista: A Technique for Recording, Encoding, and Running Platform Independent Android Tests. In 2017 IEEE International Conference on Software Testing, Verification and Validation (ICST). 149–160. https://doi.org/10.1109/ICST.2017.21
[8]
Gordon Fraser. 2017. Gamification of Software Testing. In 2017 IEEE/ACM 12th International Workshop on Automation of Software Testing (AST). 2–7. https://doi.org/10.1109/AST.2017.20
[9]
Tommaso Fulcini and Luca Ardito. 2022. Gamified Exploratory GUI Testing of Web Applications: a Preliminary Evaluation. In 2022 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 215–222. https://doi.org/10.1109/ICSTW55395.2022.00045
[10]
Félix García, Oscar Pedreira, Mario Piattini, Ana Cerdeira-Pena, and Miguel Penabad. 2017. A framework for gamification in software engineering. Journal of Systems and Software, 132 (2017), 21–40. issn:0164-1212 https://doi.org/10.1016/j.jss.2017.06.021
[11]
Jiaqi Guo, Shuyue Li, Jian-Guang Lou, Zijiang Yang, and Ting Liu. 2019. Sara: self-replay augmented record and replay for Android in industrial cases. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2019). Association for Computing Machinery, New York, NY, USA. 90–100. isbn:978-1-4503-6224-5 https://doi.org/10.1145/3293882.3330557
[12]
Selenium HQ. 2024. Selenium WebDriver. https://www.selenium.dev/documentation/webdriver/
[13]
Maurizio Leotta, Davide Paparella, and Filippo Ricca. 2024. Mutta: a novel tool for E2E web mutation testing. Software quality journal, 32, 1 (2024), 5–26. issn:0963-9314
[14]
Chien Hung Liu, Chien Yu Lu, Shan Jen Cheng, Koan Yuh Chang, Yung Chia Hsiao, and Weng Ming Chu. 2014. Capture-Replay Testing for Android Applications. In 2014 International Symposium on Computer, Consumer and Control. 1129–1132. https://doi.org/10.1109/IS3C.2014.293
[15]
Zhenyue Long, Guoquan Wu, Xiaojiang Chen, Wei Chen, and Jun Wei. 2020. WebRR: self-replay enhanced robust record/replay for web application testing. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020). Association for Computing Machinery, New York, NY, USA. 1498–1508. isbn:9781450370431 https://doi.org/10.1145/3368089.3417069
[16]
Michel Nass, Emil Alégroth, and Robert Feldt. 2019. Augmented Testing: Industry Feedback To Shape a New Testing Technology. In 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 176–183. https://doi.org/10.1109/ICSTW.2019.00048
[17]
Stas Negara, Naeem Esfahani, and Raymond Buse. 2019. Practical Android Test Recording with Espresso Test Recorder. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 193–202. https://doi.org/10.1109/ICSE-SEIP.2019.00029
[18]
Savas Ozturk. 2022. Gamification of exploratory testing process. In Proceedings of the 1st International Workshop on Gamification of Software Development, Verification, and Validation (Gamify 2022). Association for Computing Machinery, New York, NY, USA. 14–17. isbn:9781450394543 https://doi.org/10.1145/3548771.3561411
[19]
Wei Ren. 2023. Gamification in Test-Driven Development Practice. In Proceedings of the 2nd International Workshop on Gamification in Software Development, Verification, and Validation (Gamify 2023). Association for Computing Machinery, New York, NY, USA. 38–46. isbn:9798400703737 https://doi.org/10.1145/3617553.3617889
[20]
Onur Sahin, Assel Aliyeva, Hariharan Mathavan, Ayse Coskun, and Manuel Egele. 2019. RANDR: Record and Replay for Android Applications via Targeted Runtime Instrumentation. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE). 128–138. https://doi.org/10.1109/ASE.2019.00022 ISSN: 2643-1572
[21]
Philipp Straubinger and Gordon Fraser. 2022. Gamekins: gamifying software testing in jenkins. In Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings (ICSE ’22). Association for Computing Machinery, New York, NY, USA. 85–89. isbn:9781450392235 https://doi.org/10.1145/3510454.3516862
[22]
Philipp Straubinger and Gordon Fraser. 2024. Improving Testing Behavior by Gamifying IntelliJ. In Proceedings of the IEEE/ACM 46th International Conference on Software Engineering (ICSE ’24). Association for Computing Machinery, New York, NY, USA. Article 49, 13 pages. isbn:9798400702174 https://doi.org/10.1145/3597503.3623339
[23]
Mario Linares Vasquez, Kevin Moran, and Denys Poshyvanyk. 2018. Continuous, Evolutionary and Large-Scale: A New Perspective for Automated Mobile App Testing. arXiv (Cornell University), issn:2331-8422
[24]
Tanja E. J. Vos, Pekka Aho, Fernando Pastor Ricos, Olivia Rodriguez-Valdes, and Ad Mulders. 2021. testar – scriptless testing through graphical user interface. Software Testing, Verification and Reliability, 31, 3 (2021), e1771. https://doi.org/10.1002/stvr.1771 arxiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/stvr.1771. e1771 stvr.1771
Index Terms
- ScoutDroid: A Tool For Mobile Augmented Testing with Live Feedback
Recommendations
GERRY: a gamified browser tool for GUI testing
Gamify 2022: Proceedings of the 1st International Workshop on Gamification of Software Development, Verification, and ValidationGraphical User Interface (GUI) testing is a relevant step of the software development process which is not often performed thoroughly due to its unappealing nature, to the inherent fragility of test cases, and to the fact that test cases – composed ...
Multidimensional test coverage analysis: PARADIGM-COV tool
Currently, software tends to assume increasingly critical roles in our society so assuring its quality becomes ever more crucial. There are several tools and processes of software testing to help increase quality in virtually any type of software. One ...
Enhancing the Automation of GUI Testing
ICSIE '19: Proceedings of the 8th International Conference on Software and Information EngineeringGUI testing is one of the most important and significant testing approaches among all different software testing techniques. Most software errors are captured and detected through the software GUI layer. Manual testing for GUIs has its problems. It ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2024
37 pages
ISBN:9798400711138
DOI:10.1145/3678869
- General Chairs:
- Riccardo Coppola,
- Luca Ardito,
- Gordon Fraser,
- Maurizio Leotta
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 September 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
Funding Sources
- European Union
Conference
Gamify '24
Sponsor:
Gamify '24: 3rd ACM International Workshop on Gamification in Software Development, Verification, and Validation
September 17, 2024
Vienna, Austria
Upcoming Conference
ISSTA '25
- Sponsor:
- sigsoft
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 63Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)15
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in