More Web Proxy on the site http://driver.im/

survey

Dynamic Testing Techniques of Non-functional Requirements in Mobile Apps: A Systematic Mapping Study

Authors:

Misael C. Júnior,

Domenico Amalfitano,

Anna Rita Fasolino,

Stevão A. Andrade,

Márcio DelamaroAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 54, Issue 10s

Article No.: 214, Pages 1 - 38

https://doi.org/10.1145/3507903

Published: 13 September 2022 Publication History

Abstract

Context: The mobile app market is continually growing offering solutions to almost all aspects of people’s lives, e.g., healthcare, business, entertainment, as well as the stakeholders’ demand for apps that are more secure, portable, easy to use, among other non-functional requirements (NFRs). Therefore, manufacturers should guarantee that their mobile apps achieve high-quality levels. A good strategy is to include software testing and quality assurance activities during the whole life cycle of such solutions.

Problem: Systematically warranting NFRs is not an easy task for any software product. Software engineers must take important decisions before adopting testing techniques and automation tools to support such endeavors.

Proposal: To provide to the software engineers with a broad overview of existing dynamic techniques and automation tools for testing mobile apps regarding NFRs.

Methods: We planned and conducted a Systematic Mapping Study (SMS) following well-established guidelines for executing secondary studies in software engineering.

Results: We found 56 primary studies and characterized their contributions based on testing strategies, testing approaches, explored mobile platforms, and the proposed tools.

Conclusions: The characterization allowed us to identify and discuss important trends and opportunities that can benefit both academics and practitioners.

References

[1]

Abdul Muqtadir Abbasi, Mustafa Al-Tekreeti, Kshirasagar Naik, Amiya Nayak, Pradeep Srivastava, and Marzia Zaman. 2018. Characterization and detection of tail energy bugs in smartphones. IEEE Access 6 (2018), 65098–65108. DOI:

[2]

Kevin Adams. 2015. Non-functional Requirements in Systems Analysis and Design. Vol. 28. Springer, Cham. DOI:

[3]

A. S. Al-Ahmad, H. Kahtan, F. Hujainah, and H. A. Jalab. 2019. Systematic literature review on penetration testing for mobile cloud computing applications. IEEE Access 7 (2019), 173524–173540. DOI:

[4]

Diego R. Almeida, Patrícia D. L. Machado, and Wilkerson L. Andrade. 2019. Testing tools for Android context-aware applications: A systematic mapping. J. Brazil. Comput. Societ. 25, 12 (2019), 1–22. DOI:

[5]

Ali Alotaibi, James Clause, and William G. J. Halfond. 2020. Mobile app energy consumption: A study of known energy issues in mobile applications and their classification schemes–summary plan. In Proceedings of the International Conference on Software Maintenance and Evolution (ICSME’20). IEEE, New York, NY, 854–854. DOI:

[6]

Domenico Amalfitano, Vincenzo Riccio, Porfirio Tramontana, and Anna Rita Fasolino. 2020. Do memories haunt you? An automated black box testing approach for detecting memory leaks in Android apps. IEEE Access 8 (2020), 12217–12231. DOI:

[7]

Amr Amin, Amgad Eldessouki, Menna Tullah Magdy, Nouran Abdeen, Hanan Hindy, and Islam Hegazy. 2019. AndroShield: Automated Android applications vulnerability detection, a hybrid static and dynamic analysis approach. Information 10, 10 (2019), 326. DOI:

[8]

Apostolos Ampatzoglou, Stamatia Bibi, Paris Avgeriou, Marijn Verbeek, and Alexander Chatzigeorgiou. 2019. Identifying, categorizing and mitigating threats to validity in software engineering secondary studies. Inf. Softw. Technol. 106 (2019), 201–230. DOI:

[9]

Andrea Avancini and Mariano Ceccato. 2013. Security testing of the communication among Android applications. In Proceedings of the 8th International Workshop on Automation of Software Test (AST’13). IEEE, New York, NY, 57–63. DOI:

[10]

Abhijeet Banerjee, Lee Kee Chong, Clément Ballabriga, and Abhik Roychoudhury. 2017. EnergyPatch: Repairing resource leaks to improve energy-efficiency of Android apps. IEEE Trans. Softw. Eng. 44, 5 (2017), 470–490. DOI:

[11]

Silvio Barra, Rita Francese, and Michele Risi. 2019. Automating mockup-based usability testing on the mobile device. In Proceedings of the International Conference on Green, Pervasive, and Cloud Computing (GPC’19). Springer, Cham, 128–143. DOI:

[12]

Shikhar Bhatnagar, Yasir Malik, and Sergey Butakov. 2018. Analysing data security requirements of Android mobile banking application. In Proceedings of the International Conference on Intelligent, Secure, and Dependable Systems in Distributed and Cloud Environments (ISDDC’18). Springer, Cham, 30–37. DOI:

[13]

Magdalena Borys and Marek Milosz. 2018. Mobile application usability testing in quasi-real conditions—The synergy of using different methods. In Proceedings of the 11th International Conference on Human System Interaction (HSI’18). IEEE, New York, NY, 362–368. DOI:

[14]

Pierre Bourque, Richard E. Fairley, and IEEE Computer Society. 2014. Guide to the Software Engineering Body of Knowledge (SWEBOK(R)): Version 3.0 (3rd ed.). IEEE Computer Society Press, Washington, DC.

Digital Library

[15]

Haipeng Cai, Ziyi Zhang, Li Li, and Xiaoqin Fu. 2019. A large-scale study of application incompatibilities in Android. In Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis. ACM, New York, NY, 216–227. DOI:

[16]

Victor R. Basili, Gianluigi Caldiera, and H. Dieter Rombach. 1994. The goal question metric approach. Encyc. Softw. Eng.ineering 2 (1994), 528–532.

[17]

Melissa Chau and Ryan Reith. 2020. Smartphone Market Share. Retrieved from https://www.idc.com/promo/smartphone-market-share/os.

[18]

Lin Chou Cheng. 2016. The mobile app usability inspection (MAUi) framework as a guide for minimal viable product (MVP) testing in lean development cycle. In Proceedings of the 2nd International Conference in HCI and UX. ACM, New York, NY, 1–11. DOI:

[19]

Shaiful Alam Chowdhury and Abram Hindle. 2016. GreenOracle: Estimating software energy consumption with energy measurement corpora. In Proceedings of the 13th Working Conference on Mining Software Repositories (MSR’16). ACM, New York, NY, 49–60. DOI:

[20]

Thiago Adriano Coleti, Leticia da Silva Souza, Marcelo Morandini, Suzie Allard, and Pedro Luiz Pizzigatti Correa. 2017. ErgoMobile: A software to support usability evaluations in mobile devices using observation techniques. In Proceedings of the International Conference of Design, User Experience, and Usability (DUXU’17). Springer, Cham, 363–378. DOI:.

[21]

Biplab Deka, Zifeng Huang, Chad Franzen, Jeffrey Nichols, Yang Li, and Ranjitha Kumar. 2017. ZIPT: Zero-integration performance testing of mobile app designs. In Proceedings of the 30th Annual Symposium on User Interface Software and Technology (UIST’17). ACM, New York, NY, 727–736. DOI:

[22]

Marcio Delamaro, Mario Jino, and Jose Maldonado. 2016. Introduction to Software Testing (2nd ed.). Elsevier Brasil.

[23]

T. Dyba, T. Dingsoyr, and G. K. Hanssen. 2007. Applying systematic reviews to diverse study types: An experience report. In Proceedings of the 1st International Symposium on Empirical Software Engineering and Measurement (ESEM’07). IEEE, New York, NY, 225–234. DOI:

[24]

Ana Rosario Espada, María del Mar Gallardo, Alberto Salmerón, and Pedro Merino. 2017. Performance analysis of Spotify® for Android with model-based testing. Mob. Inf. Syst. 2017 (2017), 1–14. DOI:

[25]

Xavier Ferre, Elena Villalba, Héctor Julio, and Hongming Zhu. 2017. Extending mobile app analytics for usability test logging. In Proceedings of the International Conference on Human-Computer Interaction (HCI’17). Springer, Cham, 114–131. DOI:

[26]

Jackson Feijó Filho, Thiago Valle, and Wilson Prata. 2015. Automated usability tests for mobile devices through live emotions logging. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, New York, NY, 636–643. DOI:

[27]

International Organization for Standardization. 2013. ISO/IEC/IEEE International Standard—Software and systems engineering – Software testing - -Part 2:Test processes. https://ieeexplore.ieee.org/document/6588543.

[28]

Chenkai Guo, Jing Xu, Hongji Yang, Ying Zeng, and Shuang Xing. 2014. An automated testing approach for inter-application security in Android. In Proceedings of the 9th International Workshop on Automation of Software Test (AST’14). ACM, New York, NY, 8–14. DOI:

[29]

Roee Hay, Omer Tripp, and Marco Pistoia. 2015. Dynamic detection of inter-application communication vulnerabilities in Android. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA’15). ACM, New York, NY, 118–128. DOI:

[30]

Gavin Henry. 2021. Matt Lacey on mobile app usability. IEEE Softw. 38, 2 (2021), 134–136. DOI:

[31]

ISO. 2001. ISO/IEC 9126-1, Software Engineering – Product Quality. ISO, Geneva, Switzerland. https://www.iso.org/standard/22749.html.

[32]

ISO. 2011. ISO/IEC 25010:2011, Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. ISO, Geneva, Switzerland. https://www.semanticscholar.org/paper/ISO-%2F-IEC-25010-%3A-2011-Systems-and-software-%E2%80%94-and-%28/ad7102b6bd0842fe1b46ce6a9246b1.f00f51948f.

[33]

ISO. 2013. ISO/IEC/IEEE 29119-1: Software and systems engineering-Software testing-Part 1: Concepts and definitions. https://ieeexplore.ieee.org/document/6588537.

[34]

Reyhaneh Jabbarvand, Jun-Wei Lin, and Sam Malek. 2019. Search-based energy testing of Android. In Proceedings of the 41st International Conference on Software Engineering (ICSE’19). IEEE, New York, NY, 1119–1130. DOI:

[35]

Reyhaneh Jabbarvand and Sam Malek. 2017. \(\mu\)Droid: An energy-aware mutation testing framework for Android. In Proceedings of the 11th Joint Meeting on Foundations of Software Engineering (ESEC/FSE’17). ACM, New York, NY, 208–219. DOI:

[36]

Reyhaneh Jabbarvand, Forough Mehralian, and Sam Malek. 2020. Automated construction of energy test oracles for Android. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering. ACM, New York, NY, 927–938. DOI:

[37]

Marek Janicki, Mika Katara, and Tuula Pääkkönen. 2012. Obstacles and opportunities in deploying model-based GUI testing of mobile software: A survey. Softw. Test., Verif. Reliab. 22, 5 (Aug. 2012), 313–341. DOI:

[38]

JongWook Jeong, NeungHoe Kim, and Hoh Peter In. 2020. Detecting usability problems in mobile applications on the basis of dissimilarity in user behavior. Int. J. Hum.-Comput. Stud. 139 (2020), 102364. DOI:

[39]

Misael Junior, Domenico Amalfitano, Lina Garcés, Stevão Andrade, and Márcio Delamaro. 2021. Dataset on Dynamic Testing Techniques of Non-Functional Requirements on Mobile Applications. Retrieved from https://data.mendeley.com/datasets/gswvb2s2ht/3.

[40]

Anureet Kaur and Kulwant Kaur. 2018. Systematic literature review of mobile application development and testing effort estimation. J. King Saud Univ. Comput. Inf. Sci. 1, 1 (2018), 1–22. DOI:

[41]

Joseph Chan Joo Keng, Lingxiao Jiang, Tan Kiat Wee, and Rajesh Krishna Balan. 2016. Graph-aided directed testing of Android applications for checking runtime privacy behaviours. In Proceedings of the 11th International Workshop on Automation of Software Test (AST’16). ACM, New York, NY, 57–63. DOI:

[42]

Taeyeon Ki, Chang Min Park, Karthik Dantu, Steven Y. Ko, and Lukasz Ziarek. 2019. Mimic: UI compatibility testing system for Android apps. In Proceedings of the 41st International Conference on Software Engineering (ICSE’19). IEEE, New York, NY, 246–256. DOI:

[43]

Heejin Kim, Byoungju Choi, and W. Eric Wong. 2009. Performance testing of mobile applications at the unit test level. In Proceedings of the 3rd International Conference on Secure Software Integration and Reliability Improvement (SSIRI’09). Springer, Cham, 171–180. DOI:

[44]

B. Kitchenham, D. Budgen, and O. P. Brereton. 2010. The value of mapping studies: A participant-observer case study. In Proceedings of the 14th International Conference on Evaluation and Assessment in Software Engineering (EASE’10). 25–33. DOI:

[45]

B. Kitchenham and S. Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. https://www.bibsonomy.org/bibtex/23f4b30c0fe1435b642467af4cca120ef/jpmor.

[46]

Wolfgang Kluth, Karl-Heinz Krempels, and Christian Samsel. 2014. Automated usability testing for mobile applications. In Proceedings of the Web Information Systems and Technologies (WEBIST). 149–156. DOI:

[47]

Konstantin Knorr and David Aspinall. 2015. Security testing for Android mHealth apps. In Proceedings of the 8th International Conference on Software Testing, Verification and Validation Workshops (ICSTW’15). IEEE, New York, NY, 1–8. DOI:

[48]

P. Kong, L. Li, J. Gao, K. Liu, T. F. Bissyandé, and J. Klein. 2019. Automated testing of Android apps: A systematic literature review. IEEE Trans. Reliab. 68, 1 (2019), 45–66.

[49]

Artur H. Kronbauer, Celso A. S. Santos, and Vaninha Vieira. 2012. Smartphone applications usability evaluation: A hybrid model and its implementation. In Proceedings of the International Conference on Human-Centred Software Engineering (HCSE’12). Springer, Berlin, 146–163. DOI:

[50]

Ammar Lanui and Thiam Kian Chiew. 2019. A cloud-based solution for testing applications compatibility and portability on fragmented Android platform. In Proceedings of the 26th Asia-Pacific Software Engineering Conference (APSEC’19). IEEE, New York, NY, 158–164. DOI:

[51]

Jemin Lee and Hyungshin Kim. 2016. QDroid: Mobile application quality analyzer for app market curators. Mob. Inf. Syst. 2016 (2016), 1–11. DOI:

[52]

Florian Lettner and Clemens Holzmann. 2012. Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications. In Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia (MoMM’12). ACM, New York, NY, 118–127. DOI:

[53]

Xueliang Li, Yuming Yang, Yepang Liu, John P. Gallagher, and Kaishun Wu. 2020. Detecting and diagnosing energy issues for mobile applications. In Proceedings of the 29th International Symposium on Software Testing and Analysis. ACM, New York, NY, 115–127. DOI:

[54]

Hongliang Liang, Yudong Wang, Tianqi Yang, and Yue Yu. 2018. AppLance: A lightweight approach to detect privacy leak for packed applications. In Proceedings of the Nordic Conference on Secure IT Systems. Springer, Cham, 54–70. DOI:

[55]

Ao Liu, Jing Xu, Weijing Wang, Jiawei Yu, and Hongcan Gao. 2019. Automated testing of energy hotspots and defects for Android applications. In Proceedings of the International Conference on Energy Internet (ICEI’19). IEEE, New York, NY, 374–379. DOI:

[56]

Chien-Hung Liu. 2019. A compatibility testing platform for Android multimedia applications. Multimedia Tools Applic. 78, 4 (2019), 4885–4904. DOI:

[57]

Yi Liu, Jue Wang, Chang Xu, Xiaoxing Ma, and Jian Lü. 2018. NavyDroid: An efficient tool of energy inefficiency problem diagnosis for Android applications. Sci. China Inf. Sci. 61, 5 (2018), 1–20. DOI:

[58]

Yang Liu, Chaoshun Zuo, Zonghua Zhang, Shanqing Guo, and Xinshun Xu. 2018. An automatically vetting mechanism for SSL error-handling vulnerability in Android hybrid Web apps. World Wide Web 21 (2018), 127–150. DOI:

[59]

Chu Luo, Jorge Goncalves, Eduardo Velloso, and Vassilis Kostakos. 2020. A survey of context simulation for testing mobile context-aware applications. ACM Comput. Surv. 53, 1 (Feb. 2020). DOI:

[60]

Xiaoxiao Ma, Bo Yan, Guanling Chen, Chunhui Zhang, Ke Huang, Jill Drury, and Linzhang Wang. 2013. Design and implementation of a toolkit for usability testing of mobile apps. Mob. Netw. Applic. 18 (2013), 81–97. DOI:

[61]

Katherine M. Malan, Jan H. P. Eloff, and Jhani A. de Bruin. 2018. Semi-automated usability analysis through eye tracking. South Afric. Comput. J. 30 (2018), 66–84. DOI:

[62]

Abel Méndez Porras, Christian Ulises Quesada López, and Marcelo Jenkins Coronas. 2015. Automated testing of mobile applications: A systematic map and review. In Proceedings of the 28th Ibero-American Conference on Software Engineering (CIBSE’15). 1–14.

[63]

H. Muccini, A. Di Francesco, and P. Esposito. 2012. Software testing of mobile applications: Challenges and future research directions. In Proceedings of the 7th International Workshop on Automation of Software Test (AST’12). IEEE, New York, NY, 29–35.

[64]

Glenford J. Myers, Corey Sandler, and Tom Badgett. 2011. The Art of Software Testing (3rd ed.). Wiley Publishing, New York, NY.

[65]

Kshirasagar Naik, Yasir Ali, Veluppillai Mahinthan, Ajit Singh, and Abdulhakim Abogharaf. 2014. Categorizing configuration parameters of smartphones for energy performance testing. In Proceedings of the 9th International Workshop on Automation of Software Test (AST’14). ACM, New York, NY, 15–21. DOI:

[66]

Simon O’Dea. 2020. Smartphone users worldwide 2016–2021. Retrieved from https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/.

[67]

K. Petersen, S. Vakkalanka, and L. Kuzniarz. 2015. Guidelines for conducting systematic mapping studies in software engineering: An update. Inf. Softw. Technol. 64 (2015), 1–18. DOI:

[68]

Roger Pressman. 2016. Software Engineering: A Practitioner’s Approach (9th ed.). McGraw-Hill, Inc., USA.

[69]

Titis Sari Putri and Fatwa Ramdani. 2017. Reliability testing using hybrid exploratory basis of tour and fuzzy Inference System Tsukamoto. In Proceedings of the International Conference on Sustainable Information Engineering and Technology (SIET’17). IEEE, New York, NY, 176–183. DOI:

[70]

Vaibhav Rastogi, Yan Chen, and William Enck. 2013. AppsPlayground: Automatic security analysis of smartphone applications. In Proceedings of the 3rd Conference on Data and Application Security and Privacy (CODASPY’13). ACM, New York, NY, 209–220. DOI:

[71]

Mehmet Sahinoglu, Koray Incki, and Mehmet S. Aktas. 2015. Mobile application verification: A systematic mapping study. In Proceedings of the International Computational Science and Its Applications (ICCSA’15). Springer, Cham, 147–163. DOI:

[72]

Sébastien Salva and Stassia R. Zafimiharisoa. 2015. APSET, an Android aPplication SEcurity testing tool for detecting intent-based vulnerabilities. Int. J. Softw. Tools Technol. Transf. 17, 2 (2015), 201–221. DOI:

[73]

João B. F. Sequeiros, Francisco T. Chimuco, Musa G. Samaila, Mário M. Freire, and Pedro R. M. Inácio. 2020. Attack and system modeling applied to IoT, cloud, and mobile ecosystems: Embedding security by design. ACM Comput. Surv. 53, 2 (2020), 25:1–25:32. DOI:

[74]

Hossain Shahriar, Sarah North, and Edward Mawangi. 2014. Testing of memory leak in Android applications. In Proceedings of the 15th International Symposium on High-Assurance Systems Engineering. IEEE, New York, NY, 176–183. DOI:

[75]

Shangcheng Shi, Xianbo Wang, and Wing Cheong Lau. 2019. MoSSOT: An automated blackbox tester for single sign-on vulnerabilities in mobile applications. In Proceedings of the Asia Conference on Computer and Communications Security (ASIACCS’19. ACM, New York, NY, 269–282. DOI:

[76]

Lady Silva and Denivaldo Lopes. 2020. Model driven engineering for performance testing in mobile applications. In Proceedings of the 5th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM’20). IEEE, New York, NY, 1–7. DOI:

[77]

Ian Sommerville. 2011. Software Engineering (9th ed.). Addison-Wesley Publishing Company, USA.

[78]

Oleksii Starov, Sergiy Vilkomir, Anatoliy Gorbenko, and Vyacheslav Kharchenko. 2015. Testing-as-a-Service for Mobile Applications: State-of-the-Art Survey. Vol. 307. Springer, Cham. DOI:

[79]

Carola Trahms, Sebastian Möller, and Jan-Niklas Voigt-Antons. 2018. Estimating quality ratings from touch interactions in mobile games. In Proceedings of the 10th International Conference on Quality of Multimedia Experience (QoMEX’18). IEEE, New York, NY, 1–6. DOI:

[80]

Porfirio Tramontana, Domenico Amalfitano, Nicola Amatucci, and Anna Rita Fasolino. 2019. Automated functional testing of mobile applications: A systematic mapping study. Softw. Qual. J. 27, 1 (2019), 149–201. DOI:

[81]

Muhammad Usman, Muhammad Zohaib Iqbal, and Muhammad Uzair Khan. 2020. An automated model-based approach for unit-level performance test generation of mobile applications. J. Softw.: Evol. Process 32 (2020), e2215.

[82]

Wesley van der Lee and Sicco Verwer. 2018. Vulnerability detection on mobile applications using state machine inference. In Proceedings of the European Symposium on Security and Privacy Workshops (EuroS&PW’18). IEEE, New York, NY, 1–10. DOI:

[83]

Mian Wan, Yuchen Jin, Ding Li, and William G. J. Halfond. 2015. Detecting display energy hotspots in Android apps. In Proceedings of the 8th International Conference on Software Testing, Verification and Validation (ICST’15). IEEE, New York, NY, 1–10. DOI:

[84]

Yingjie Wang, Guangquan Xu, Xing Liu, Weixuan Mao, Chengxiang Si, Witold Pedrycz, and Wei Wang. 2020. Identifying vulnerabilities of SSL/TLS certificate verification in Android apps with static and dynamic analysis. J. Syst. Softw. 167 (2020), 110609. DOI:

[85]

Kun Yang, Jianwei Zhuge, Yongke Wang, Lujue Zhou, and Haixin Duan. 2014. IntentFuzzer: Detecting capability leaks of Android applications. In Proceedings of the 9th Symposium on Information, Computer and Communications Security. ACM, New York, NY, 531–536. DOI:

[86]

Badamasi Imam Ya’u, Norsaremah Salleh, Azlin Nordin, Norbik Bashah Idris, Hafiza Abas, and Ali Amer Alwan. 2019. A systematic mapping study on cloud-based mobile application testing. J. Inf. Commun. Technol. 18, 4 (2019), 485–527. DOI:

[87]

Shengcheng Yu, Chunrong Fang, Yexiao Yun, and Yang Feng. 2021. Layout and image recognition driving cross-platform automated mobile testing. In Proceedings of the IEEE/ACM 43rd International Conference on Software Engineering (ICSE’21). IEEE, New York, NY, 1561–1571. DOI:

[88]

Noorrezam Yusop, Massila Kamalrudin, Safiah Sidek, and John Grundy. 2016. Automated support to capture and validate security requirements for mobile apps. In Proceedings of the Asia Pacific Requirements Engineering Conference (APSEC’16). Springer, Singapore, 97–112. DOI:

[89]

Samer Zein, Norsaremah Salleh, and John Grundy. 2016. A systematic mapping study of mobile application testing techniques. J. Syst. Softw. 117, C (July 2016), 334–356. DOI:

[90]

Hailong Zhang, Haowei Wu, and Atanas Rountev. 2016. Automated test generation for detection of leaks in Android applications. In Proceedings of the 11th International Workshop on Automation of Software Test. ACM, New York, NY, 64–70. DOI:

[91]

Tao Zhang, Jerry Gao, Jing Cheng, and Tadahiro Uehara. 2015. Compatibility testing service for mobile applications. In Proceedings of the Symposium on Service-Oriented System Engineering (SOSE’15). IEEE, New York, NY, 179–186. DOI:

[92]

Chenyang Zhu, Zhengwei Zhu, Yunxin Xie, Wei Jiang, and Guiling Zhang. 2019. Evaluation of machine learning approaches for Android energy bugs detection with revision commits. IEEE Access 7 (2019), 85241–85252. DOI:

Cited By

Vasquez-Cevallos LMitchell AMuñoz-Hernández SHerranz-Nieva ÁGarcia-Mingo ADe Corral-San Martin PCastro MSoto-Rodriguez PParrales-Bravo FCaicedo-Quiroz R(2025)Educational and Clinical Applications of a Web- and Android-Based Telemedicine Platform to Expand Rural Health Care in EcuadorTelemedicine Reports10.1089/tmr.2024.00916:1(67-75)Online publication date: 1-Jan-2025
https://doi.org/10.1089/tmr.2024.0091
Tanzil MChowdhury SModaberi SUddin GHemmati H(2025)A systematic mapping study of crowd knowledge enhanced software engineering research using Stack OverflowJournal of Systems and Software10.1016/j.jss.2025.112405(112405)Online publication date: Mar-2025
https://doi.org/10.1016/j.jss.2025.112405
Marinho EPessoa Neto IFerreira FDiniz JFigueiredo E(2024)RIFDiscoverer: A Tool for Finding Resource Interaction FailuresProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676603(30-33)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3676603
Show More Cited By

Index Terms

Dynamic Testing Techniques of Non-functional Requirements in Mobile Apps: A Systematic Mapping Study
1. General and reference
  1. Document types
    1. Surveys and overviews
2. Software and its engineering
  1. Software organization and properties
    1. Extra-functional properties

Recommendations

Are "non-functional" requirements really non-functional?: an investigation of non-functional requirements in practice
ICSE '16: Proceedings of the 38th International Conference on Software Engineering

Non-functional requirements (NFRs) are commonly distinguished from functional requirements by differentiating how the system shall do something in contrast to what the system shall do. This distinction is not only prevalent in research, but also ...
A systematic mapping study of mobile application testing techniques

We performed a systematic mapping study on mobile application testing techniques.79 empirical studies are mapped to a classification schema.Classification scheme includes, structure the topic, evaluation type and contribution facets.Several research ...
Testing of Mobile Applications in the Wild: A Large-Scale Empirical Study on Android Apps
ICPC '20: Proceedings of the 28th International Conference on Program Comprehension

Nowadays, mobile applications (a.k.a., apps) are used by over two billion users for every type of need, including social and emergency connectivity. Their pervasiveness in today's world has inspired the software testing research community in devising ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 54, Issue 10s

January 2022

831 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/3551649

Editor:
Albert Zomaya
University of Sydney, Australia

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2022

Online AM: 12 January 2022

Accepted: 20 December 2021

Revised: 29 October 2021

Received: 28 January 2021

Published in CSUR Volume 54, Issue 10s

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Refereed

Funding Sources

Coordenação de Aperfeiçoamento de Pessoal de Nível Superior — Brasil (CAPES) — Finance
Fundação de Amparo a Pesquisa do Estado de São Paulo - FAPESP (São Paulo Research Foundation)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
1,066
Total Downloads

Downloads (Last 12 months)224
Downloads (Last 6 weeks)23

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vasquez-Cevallos LMitchell AMuñoz-Hernández SHerranz-Nieva ÁGarcia-Mingo ADe Corral-San Martin PCastro MSoto-Rodriguez PParrales-Bravo FCaicedo-Quiroz R(2025)Educational and Clinical Applications of a Web- and Android-Based Telemedicine Platform to Expand Rural Health Care in EcuadorTelemedicine Reports10.1089/tmr.2024.00916:1(67-75)Online publication date: 1-Jan-2025
https://doi.org/10.1089/tmr.2024.0091
Tanzil MChowdhury SModaberi SUddin GHemmati H(2025)A systematic mapping study of crowd knowledge enhanced software engineering research using Stack OverflowJournal of Systems and Software10.1016/j.jss.2025.112405(112405)Online publication date: Mar-2025
https://doi.org/10.1016/j.jss.2025.112405
Marinho EPessoa Neto IFerreira FDiniz JFigueiredo E(2024)RIFDiscoverer: A Tool for Finding Resource Interaction FailuresProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676603(30-33)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3676603
Marinho E(2024)Characterizing Resource Interaction Failures in Mobile ApplicationsProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676601(11-16)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3676601
Marinho EFerreira FFernandes EDiniz JFigueiredo E(2024)Resource Interaction Failures in Mobile Applications: A Challenge for the Software Product Line Testing CommunityProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676537(203-208)Online publication date: 2-Sep-2024
https://dl.acm.org/doi/10.1145/3646548.3676537
Marinho EFerreira FDiniz JFigueiredo E(2023)Applying Spectrum-Based Fault Localization to Android ApplicationsProceedings of the XXXVII Brazilian Symposium on Software Engineering10.1145/3613372.3613397(257-266)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3613372.3613397
Kuroishi PMaldonado JVincenzi A(2023)Towards the Implementation of a Mobile Application Testing Infrastructure at Von Braun Labs2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE59848.2023.00078(91-101)Online publication date: 9-Oct-2023
https://doi.org/10.1109/ISSRE59848.2023.00078
Marinho EFerreira FDiniz JFigueiredo E(2023)Evaluating testing strategies for resource related failures in mobile applicationsSoftware Quality Journal10.1007/s11219-023-09627-331:4(1121-1147)Online publication date: 21-Apr-2023
https://dl.acm.org/doi/10.1007/s11219-023-09627-3
Papaphilippou PMeng JGebara NLuk W(2021)Hipernetch: High-Performance FPGA Network SwitchACM Transactions on Reconfigurable Technology and Systems10.1145/347705415:1(1-31)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3477054

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents