More Web Proxy on the site http://driver.im/

research-article

TestAWARE: A Laboratory-Oriented Testing Tool for Mobile Context-Aware Applications

Authors:

Miikka Kuutila,

Denzil Ferreira,

Jorge Goncalves,

Mika Mäntylä,

Vassilis KostakosAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 3

Article No.: 80, Pages 1 - 29

https://doi.org/10.1145/3130945

Published: 11 September 2017 Publication History

Abstract

Although mobile context instrumentation frameworks have simplified the development of mobile context-aware applications, it remains challenging to test such applications. In this paper, we present TestAWARE that enables developers to systematically test context-aware applications in laboratory settings. To achieve this, TestAWARE is able to download, replay and emulate contextual data on either physical devices or emulators. To support both white -box and black-box testing, TestAWARE has been implemented as a novel structure with a mobile client and code library. In blackbox testing scenarios, developers can manage data replay through the mobile client, without writing testing scripts or modifying the source code of the targeted application. In white-box testing scenarios, developers can manage data replay and test functional/non-functional properties of the targeted application by writing testing scripts using the code library. We evaluated TestAWARE by quantifying its maximal data replay speed, and by conducting a user study with 13 developers. We show that TestAWARE can overcome data synchronisation challenges, and found that PC-based emulators can replay data significantly faster than physical smartphones and tablets. The user study highlights the usefulness of TestAWARE in the systematic testing of mobile context-aware applications in laboratory settings.

References

[1]

Domenico Amalfitano, Anna R. Fasolino and Porfirio Tramontana. 2011. A GUI Crawling-Based Technique for Android Mobile Application Testing. In International Conference on Software Testing, Verification and Validation Workshops, IEEE, 252-261.

Digital Library

[2]

Domenico Amalfitano, Anna R. Fasolino, Porfirio Tramontana and Nicola Amatucci. 2013. Considering Context Events in Event-Based Testing of Mobile Applications. In International Conference on Software Testing, Verification and Validation Workshops, IEEE, 126-133.

Digital Library

[3]

Application Exerciser Monkey. Retrieved 17/12/2014 from http://developer.android.com/tools/help/monkey.html

[4]

Martin Atzmueller and Katy Hilgenberg. 2013. Towards Capturing Social Interactions with SDCF: An Extensible Framework for Mobile Sensing and Ubiquitous Data Collection. In Proceedings of the 4th International Workshop on Modeling Social Media, ACM, 6:1-6:4.

Digital Library

[5]

Rajesh K. Balan, Darren Gergle, Mahadev Satyanarayanan and James Herbsleb. 2007. Simplifying cyber foraging for mobile devices. In Proceedings of the 5th international conference on Mobile systems, applications and services, 272-285.

Digital Library

[6]

Szymon Bobek, Sebastian Dziadzio, Paweł Jaciów, Mateusz Ślażyński and Grzegorz J. Nalepa. 2015. Understanding Context with ContextViewer -- Tool for Visualization and Initial Preprocessing of Mobile Sensors Data. Springer International Publishing.

[7]

David Chu, Nicholas D. Lane, Ted T. Lai, Cong Pang, Xiangying Meng, Qing Guo, Fan Li and Feng Zhao. 2011. Balancing Energy, Latency and Accuracy for Mobile Sensor Data Classification. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems, ACM, 54-67.

Digital Library

[8]

Karen Church and Barry Smyth. 2008. Understanding the intent behind mobile information needs. In Proceedingsc of the 13th international conference on Intelligent user interfaces - IUI ‘09, 247-256.

Digital Library

[9]

Context Simulator (KnowMe). Retrieved 14/04/2016 from http://glados.kis.agh.edu.pl/doku.php?id=pub:software:contextsimulator:start

[10]

Denzil Ferreira, Vassilis Kostakos and Anind K. Dey. 2015. AWARE: mobile context instrumentation framework. Frontiers in ICT 2, 6: 1-9.

[11]

Lorenzo Gomez, Iulian Neamtiu, Tanzirul Azim and Todd Millstein. 2013. RERAN: Timing- and touch-sensitive record and replay for Android. In International Conference on Software Engineering, IEEE, 72-81.

Digital Library

[12]

Tobias Griebe and Volker Gruhn. 2014. A model-based approach to test automation for context-aware mobile applications. In Proceedings of the 29th Annual ACM Symposium on Applied Computing, 420-427.

Digital Library

[13]

Matthew Halpern, Yuhao Zhu, Ramesh Peri and Vijay J. Reddi. 2015. Mosaic: cross-platform user-interaction record and replay for the fragmented android ecosystem. In International Symposium on Performance Analysis of Systems and Software, IEEE, 215-224.

[14]

Kaasila, Denzil Ferreira, Vassilis Kostakos and Timo Ojala. 2012. Testdroid: automated remote UI testing on Android. In International Conference on Mobile and Ubiquitous Multimedia, ACM, 28:1-28:4.

Digital Library

[15]

Reed Larson and Mihaly Csikszentmihalyi. 1983. The Experience Sampling Method. In Flow and the Foundations of Positive Psychology (eds.). Wiley Jossey-Bass, San Francisco, 15, 41-56.

[16]

Heng Lu, W. K. Chan and T. H. Tse. 2006. Testing Context-aware Middleware-centric Programs: A Data Flow Approach and an RFID-based Experimentation. In Proceedings of the 14th ACM SIGSOFT International Symposium on Foundations of Software Engineering, ACM, 242-252.

Digital Library

[17]

Chu Luo, Miikka Kuutila, Simon Klakegg, Denzil Ferreira, Huber Flores, Jorge Goncalves, Vassilis Kostakos and Mika Mäntylä. 2016. How to Validate Mobile Crowdsourcing Design? Leveraging Data Integration in Prototype Testing. In International Joint Conference on Pervasive and Ubiquitous Computing Adjunct, ACM.

Digital Library

[18]

Qi Luo, Denys Poshyvanyk, Aswathy Nair and Mark Grechanik. 2016. FOREPOST: A Tool for Detecting Performance Problems with Feedback-driven Learning Software Testing. In Proceedings of the 38th International Conference on Software Engineering Companion, ACM, 593-596.

Digital Library

[19]

Chulhong Min, Seungchul Lee, Changhun Lee, Youngki Lee, Seungwoo Kang, Seungpyo Choi, Wonjung Kim and Junehwa Song. 2016. PADA: Power-aware Development Assistant for Mobile Sensing Applications. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, 946-957.

Digital Library

[20]

monkeyrunner | Android Developers. Retrieved 03/05/2016 from http://developer.android.com/tools/help/monkeyrunner_concepts.html

[21]

Henry Muccini, Antonio D. Francesco and Patrizio Esposito. 2012. Software testing of mobile applications: Challenges and future research directions. In Automation of Software Test (AST), 2012 7th International Workshop on, 29-35.

Digital Library

[22]

Zhengrui Qin, Yutao Tang, Ed Novak and Qun Li. 2016. MobiPlay: A Remote Execution Based Record-and-replay Tool for Mobile Applications. In Proceedings of the 38th International Conference on Software Engineering, ACM, 571-582.

Digital Library

[23]

Kiran K. Rachuri, Mirco Musolesi, Cecilia Mascolo, Peter J. Rentfrow, Chris Longworth and Andrius Aucinas. 2010. EmotionSense: a mobile phones based adaptive platform for experimental social psychology research. In Proceedings of the 12th ACM international conference on Ubiquitous computing, ACM, 281-290.

Digital Library

[24]

Luis Roalter, Andreas Moller, Stefan Diewald and Matthias Kranz. 2011. Developing intelligent environments: A development tool chain for creation, testing and simulation of smart and intelligent environments. In Intelligent Environments (IE), 2011 7th International Conference on, 214-221.

Digital Library

[25]

M Satyanarayanan. 2001. Pervasive computing: Vision and challenges. Personal Communications, IEEE 8, 4: 10-17.

[26]

Choonsung Shin, Jin-Hyuk Hong and Anind K. Dey. 2012. Understanding and Prediction of Mobile Application Usage for Smart Phones. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, ACM, 173-182.

Digital Library

[27]

Melanie Swan. 2013. The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery. Big Data 1, 2: 85-99.

[28]

Ralf Tonjes, Eike S. Reetz, Marten Fischer and Daniel Kuemper. 2015. Automated Testing of Context-Aware Applications. In Vehicular Technology Conference, IEEE, 1-5.

[29]

Niels van Berkel, Chu Luo, Theodoros Anagnostopoulos, Denzil Ferreira, Jorge Goncalves, Simo Hosio and Vassilis Kostakos. 2016. A Systematic Assessment of Smartphone Usage Gaps. In Conference on Human Factors in Computing Systems, ACM, 4711-4721.

Digital Library

[30]

Martin White, Mario Linares-Vásquez, Peter Johnson, Carlos Bernal-Cárdenas and Denys Poshyvanyk. 2015. Generating Reproducible and Replayable Bug Reports from Android Application Crashes. In Proceedings of the 2015 IEEE 23rd International Conference on Program Comprehension, IEEE Press, 48-59.

Digital Library

Cited By

Qian XWang TXu XJonker TTodi K(2024)Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642158(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642158
de Almeida DMachado PAndrade WCavalcante EDantas FBatista T(2020)Context-Aware Android Applications TestingProceedings of the XXXIV Brazilian Symposium on Software Engineering10.1145/3422392.3422405(283-292)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3422392.3422405
Luo CGoncalves JVelloso EKostakos V(2020)A Survey of Context Simulation for Testing Mobile Context-Aware ApplicationsACM Computing Surveys10.1145/337278853:1(1-39)Online publication date: 6-Feb-2020
https://dl.acm.org/doi/10.1145/3372788
Show More Cited By

Index Terms

TestAWARE: A Laboratory-Oriented Testing Tool for Mobile Context-Aware Applications
1. Human-centered computing
  1. Ubiquitous and mobile computing
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation

Recommendations

Bluewave: enabling opportunistic context sharing via bluetooth device names
EICS '16: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Context-aware applications oftentimes require devices to share a user's context in order to provide them with relevant information and services. However, current context-sharing techniques require significant amounts of setup before they can be used, ...
Semantic enrichment of mobile phone data records
MUM '13: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia

The pervasiveness of mobile phones creates an unprecedented opportunity for analyzing human dynamics with the help of the data they generate. This enables a novel human-driven approach for service creation in a variety of domains (e.g., healthcare, ...
Understanding and Detecting Harmful Code
SBES '20: Proceedings of the XXXIV Brazilian Symposium on Software Engineering

Code smells typically indicate poor design implementation and choices that may degrade software quality. Hence, they need to be carefully detected to avoid such poor design. In this context, some studies try to understand the impact of code smells on the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 3

September 2017

2023 pages

EISSN:2474-9567

DOI:10.1145/3139486

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017

Accepted: 01 July 2017

Revised: 01 May 2017

Received: 01 November 2016

Published in IMWUT Volume 1, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
344
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qian XWang TXu XJonker TTodi K(2024)Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642158(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642158
de Almeida DMachado PAndrade WCavalcante EDantas FBatista T(2020)Context-Aware Android Applications TestingProceedings of the XXXIV Brazilian Symposium on Software Engineering10.1145/3422392.3422405(283-292)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3422392.3422405
Luo CGoncalves JVelloso EKostakos V(2020)A Survey of Context Simulation for Testing Mobile Context-Aware ApplicationsACM Computing Surveys10.1145/337278853:1(1-39)Online publication date: 6-Feb-2020
https://dl.acm.org/doi/10.1145/3372788
Almeida DMachado PAndrade W(2019)Testing tools for Android context-aware applications: a systematic mappingJournal of the Brazilian Computer Society10.1186/s13173-019-0093-725:1Online publication date: 1-Dec-2019
https://doi.org/10.1186/s13173-019-0093-7
Luo CMa XTian YGoncalves JVelloso EKostakos V(2019)Verifying nondeterministic processes driven by broadcasts on Android2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC)10.1109/ITNEC.2019.8729296(341-348)Online publication date: Mar-2019
https://doi.org/10.1109/ITNEC.2019.8729296
Luo CXu ZDong RGoncalves JVelloso EKostakos V(2019)CamTest: A laboratory testbed for camera-based mobile sensing applicationsPervasive and Mobile Computing10.1016/j.pmcj.2019.04.001Online publication date: Apr-2019
https://doi.org/10.1016/j.pmcj.2019.04.001
Yumura TEnomoto MAkashi KHirose FInoue TUda SMiyachi TTan YShinoda Y(2018)AOBAKOProceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers10.1145/3267305.3267568(476-479)Online publication date: 8-Oct-2018
https://dl.acm.org/doi/10.1145/3267305.3267568
Klakegg SGoncalves JLuo CVisuri APopov Avan Berkel NSarsenbayeva ZKostakos VHosio SSavage SBykov AMeglinski IFerreira D(2018)Assisted Medication Management in Elderly Care Using Miniaturised Near-Infrared SpectroscopyProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32142722:2(1-24)Online publication date: 5-Jul-2018
https://dl.acm.org/doi/10.1145/3214272
Luo CMa XTian YZhang YXu Z(2018)A Variation of Quicksort for Model Checking with Promela and SPIN2018 IEEE International Conference of Safety Produce Informatization (IICSPI)10.1109/IICSPI.2018.8690479(484-488)Online publication date: Dec-2018
https://doi.org/10.1109/IICSPI.2018.8690479
Mehmood MKhan MAfzal W(2018)Automating Test Data Generation for Testing Context-Aware Applications2018 IEEE 9th International Conference on Software Engineering and Service Science (ICSESS)10.1109/ICSESS.2018.8663920(104-108)Online publication date: Nov-2018
https://doi.org/10.1109/ICSESS.2018.8663920
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents