More Web Proxy on the site http://driver.im/

research-article

An empirical study of mobile network behavior and application performance in the wild

Authors:

Rocky K. C. Chang,

Ricky K. P. MokAuthors Info & Claims

IWQoS '19: Proceedings of the International Symposium on Quality of Service

Article No.: 4, Pages 1 - 10

https://doi.org/10.1145/3326285.3329039

Published: 24 June 2019 Publication History

Abstract

Monitoring mobile network performance is critical for optimizing the QoE of mobile apps. Until now, few studies have considered the actual network performance that mobile apps experience in a per-app or per-server granularity. In this paper, we analyze a two-year-long dataset collected by a crowdsourcing per-app measurement tool to gain new insights into mobile network behavior and application performance. We observe that only a small portion of WiFi networks can work in high-speed mode, and more than one-third of the observed ISPs still have not deployed 4G networks. For cellular networks, the DNS settings on smartphones can have a significant impact on mobile app network performance. Moreover, we notice that instant messaging (IM) and voice over IP (VoIP) services nowadays are not as performant as Web services, because the traffic using XMPP experiences longer latencies than HTTPS. We propose an automatic performance degradation detection and localization method for finding possible network problems in our huge, imbalanced and sparse dataset. Our evaluation and case studies show that our method is effective and the running time is acceptable.

References

[1]

Anycast dataset. https://anycast.telecom-paristech.fr/dataset/.

[2]

Easy List. https://easylist.to/.

[3]

Geo IP Lookup. http://geoiplookup.net/.

[4]

MobiPerf. http://www.mobiperf.com/.

[5]

MobiPerf on Google Play. https://play.google.com/store/apps/details?id=com.mobiperf.

[6]

Netalyzr on Google Play. https://play.google.com/store/apps/details?id=edu.berkeley.icsi.netalyzr.android.

[7]

Speedtest by Ookla. https://play.google.com/store/apps/details?id=org.zwanoo.android.speedtest.

[8]

Speedtest.net on Google Play. https://play.google.com/store/apps/details?id=org.zwanoo.android.speedtest.

[9]

The GeoNames geographical database. http://geonames.org/.

[10]

VpnService on Android Developers. http://developer.android.com/reference/android/net/VpnService.html.

[11]

Worldwide enterprise WLAN market sees steady growth in full year and Q4 2017, according to IDC. https://www.idc.com/getdoc.jsp?containerId=prUS43599518.

[12]

R. Agrawal, T. Imieliński, and A. Swami. Mining association rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, SIGMOD '93, pages 207--216. ACM, 1993.

Digital Library

[13]

R. Agrawal and R. Srikant. Fast algorithms for mining association rules in large databases. In Proceedings of the 20th International Conference on Very Large Data Bases, VLDB '94, pages 487--499. Morgan Kaufmann Publishers Inc., 1994.

Digital Library

[14]

F. Ahmed, J. Erman, Z. Ge, A. X. Liu, J. Wang, and H. Yan. Detecting and localizing end-to-end performance degradation for cellular data services based on TCP loss ratio and round trip time. IEEE/ACM Transactions on Networking, 25(6):3709--3722, Dec 2017.

Digital Library

[15]

C. Amrutkar, M. Hiltunen, T. Jim, K. Joshi, O. Spatscheck, P. Traynor, and S. Venkataraman. Why is my smartphone slow? on the fly diagnosis of underperformance on the mobile internet. In Proc. IEEE/IFIP DSN, 2013.

Digital Library

[16]

D. Baltrunas, A. Elmokashfi, and A. Kvalbein. Measuring the reliability of mobile broadband networks. In Proc. ACM IMC, 2014.

Digital Library

[17]

W. Cai, R. Shea, C.-Y. Huang, K.-T. Chen, J. Liu, V. C. Leung, and C.-H. Hsu. The future of cloud gaming {point of view}. Proceedings of the IEEE, 104(4):687--691, 2016.

[18]

M. Calder, A. Flavel, E. Katz-Bassett, R. Mahajan, and J. Padhye. Analyzing the performance of an anycast cdn. In Proceedings of the 2015 Internet Measurement Conference, IMC '15, pages 531--537, New York, NY, USA, 2015. ACM.

Digital Library

[19]

V. Cardellini, M. Colajanni, and P. S. Yu. Dynamic load balancing on web-server systems. 3(3):28--39, 1999.

[20]

R. Chartrand and W. Yin. Iteratively reweighted algorithms for compressive sensing. In 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, pages 3869--3872, March 2008.

[21]

Q. A. Chen, H. Luo, S. Rosen, Z. M. Mao, K. Iyer, J. Hui, K. Sontineni, and K. Lau. QoE Doctor: Diagnosing mobile app QoE with automated UI control and cross-layer analysis. In Proc. ACM IMC, 2014.

Digital Library

[22]

X. Chen, R. Jin, K. Suh, B. Wang, and W. Wei. Network performance of smart mobile handhelds in a university campus WiFi network. In Proc. ACM IMC, 2012.

Digital Library

[23]

D. Cicalese, J. Augé", D. Joumblatt, T. Friedman, and D. Rossi. Characterizing ipv4 anycast adoption and deployment. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies, CoNEXT '15, pages 16:1--16:13, New York, NY, USA, 2015. ACM.

Digital Library

[24]

D. Cicalese, J. Augé, D. Joumblatt, T. Friedman, and D. Rossi. Characterizing ipv4 anycast adoption and deployment. In Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies, CoNEXT '15, pages 16:1--16:13, New York, NY, USA, 2015. ACM.

Digital Library

[25]

A. Hornsby and R. Walsh. From instant messaging to cloud computing, an XMPP review. In IEEE International Symposium on Consumer Electronics (ISCE 2010), pages 1--6, 2010.

[26]

J. Huang, F. Qian, A. Gerber, Z. M. Mao, S. Sen, and O. Spatscheck. A close examination of performance and power characteristics of 4G LTE networks. In Proc. ACM MobiSys, 2012.

Digital Library

[27]

J. Huang, F. Qian, Y. Guo, Y. Zhou, Q. Xu, Z. M. Mao, S. Sen, and O. Spatscheck. An in-depth study of LTE: Effect of network protocol and application behavior on performance. In Proc. ACM SIGCOMM, 2013.

Digital Library

[28]

J. Huang, F. Qian, Z. M. Mao, S. Sen, and O. Spatscheck. Screen-off traffic characterization and optimization in 3G/4G networks. In Proc. ACM IMC, 2012.

Digital Library

[29]

J. Huang, Q. Xu, B. Tiwana, Z. M. Mao, M. Zhang, and P. Bahl. Anatomizing application performance differences on smartphones. In Proc. ACM MobiSys, 2010.

Digital Library

[30]

H. Jiang, Y. Wang, K. Lee, and I. Rhee. Tackling bufferbloat in 3G/4G networks. In Proc. ACM IMC, 2012.

Digital Library

[31]

A. Le, J. Varmarken, S. Langhoff, A. Shuba, M. Gjoka, and A. Markopoulou. Antmonitor: A system for monitoring from mobile devices. In C2BD SIGCOMM, 2015.

[32]

W. Li, R. K. P. Mok, D. Wu, and R. K. C. Chang. On the accuracy of smartphone-based mobile network measurement. In 2015 IEEE Conference on Computer Communications (INFOCOM), pages 370--378, April 2015.

[33]

W. Li, D. Wu, R. K. Chang, and R. K. Mok. Demystifying and puncturing the inflated delay in smartphone-based wifi network measurement. In Proceedings of the 12th International on Conference on Emerging Networking Experiments and Technologies, CoNEXT '16, pages 497--504, New York, NY, USA, 2016. ACM.

Digital Library

[34]

Z. Li, D. Levin, N. Spring, and B. Bhattacharjee. Internet anycast: Performance, problems, & potential. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, SIGCOMM '18, pages 59--73, New York, NY, USA, 2018. ACM.

Digital Library

[35]

Q. Liu, K. Xu, H. Wang, M. Shen, L. Li, and Q. Xiao. Measurement, modeling, and analysis of TCP in high-speed mobility scenarios. In Proc. IEEE ICDCS, 2016.

[36]

G. LLC. HTTPS encryption on the web. https://transparencyreport.google.com/ https/.

[37]

H. B. Mann and D. R. Whitney. On a test of whether one of two random variables is stochastically larger than the other. 18(1):50--60, 1947.

[38]

A. Nikravesh, H. Yao, S. Xu, D. Choffnes, and Z. M. Mao. Mobilyzer: An open platform for controllable mobile network. In Proc. ACM MobiSys, 2015.

Digital Library

[39]

A. Patro, S. Rayanchu, M. Griepentrog, Y. Ma, and S. Banerjee. Capturing mobile experience in the wild: A tale of two apps. In Proc. ACM CoNEXT, 2013.

Digital Library

[40]

C. Pei, Y. Zhao, G. Chen, R. Tang, Y. Meng, M. Ma, K. Ling, and D. Pei. WiFi can be the weakest link of round trip network latency in the wild. In Proc. IEEE INFOCOM, 2016.

[41]

A. Razaghpanah, N. Vallina-Rodriguez, S. Sundaresan, C. Kreibich, P. Gill, M. Allman, and V. Paxso. Haystack: A multi-purpose mobile vantage point in user space. Technical report, arXiv:1510.01419, 2016.

[42]

P. R. Rider. Variance of the median of small samples from several special populations. 55(289):148--150, 1960.

[43]

S. Rosen, H. Luo, Q. A. Chen, Z. M. Mao, J. Hui, A. Drake, and K. Lau. Discovering fine-grained RRC state dynamics and performance impacts in cellular networks. In Proc. ACM MobiCom, 2014.

Digital Library

[44]

S. Rosen, H. Luo, Q. A. Chen, Z. M. Mao, J. Hui, A. Drake, and K. Lau. Understanding RRC state dynamics through client measurements with Mobilyzer. In Proc. the 6th Annual Workshop on Wireless of the Students, by the Students, for the Students (S3), 2014.

Digital Library

[45]

J. P. Rula and F. E. Bustamante. Behind the curtain: Cellular DNS and content replica selection. In Proc. ACM IMC, 2014.

Digital Library

[46]

S. Sarat, V. Pappas, and A. Terzis. On the use of anycast in dns. In Proceedings of 15th International Conference on Computer Communications and Networks, pages 71--78, Oct 2006.

[47]

A. Shaikh, R. Tewari, and M. Agrawal. On the effectiveness of DNS-based server selection. In Proc. IEEE INFOCOM, 2001.

[48]

J. Sommers and P. Barford. Cell vs. WiFi: On the performance of metro area mobile connections. In Proc. ACM IMC, 2012.

Digital Library

[49]

S. M. Stigler. Studies in the history of probability and statistics. XXXII: Laplace, fisher and the discovery of the concept of sufficiency. 60(3):439--445, 1973.

[50]

K. Sui, M. Zhou, D. Liu, M. Ma, D. Pei, Y. Zhao, Z. Li, and T. Moscibroda. Characterizing and improving WiFi latency in large-scale operational networks. In Proc. ACM MobiSys, 2016.

Digital Library

[51]

Y. Sun, Y. Zhao, Y. Su, D. Liu, X. Nie, Y. Meng, S. Cheng, D. Pei, S. Zhang, X. Qu, and X. Guo. Hotspot: Anomaly localization for additive KPIs with multidimensional attributes. IEEE Access, 6: 10909--10923, 2018.

[52]

N. Vallina-Rodriguez, A. Auçinas, M. Almeida, Y. Grunenberger, K. Papagiannaki, and J. Crowcroft. RILAnalyzer: A comprehensive 3G monitor on your phone. In Proc. ACM IMC, 2013.

Digital Library

[53]

N. Vallina-Rodriguez, N. Weaver, C. Kreibich, and V. Paxson. Netalyzr for Android: Challenges and opportunities. In Proc. Workshop on Active Internet Measurements (AIMS), 2014.

[54]

N. Vallina-Rodriguez, S. Sundaresan, C. Kreibich, N. Weaver, and V. Paxson. Beyond the radio: Illuminating the higher layers of mobile networks. In Proc. ACM MobiSys, 2015.

Digital Library

[55]

Z. Wang, J. Huang, and S. Rose. Evolution and challenges of DNS-based CDNs. Digital Communications and Networks, 4(4):235 -- 243, 2018.

[56]

S. Wassermann, J. P. Rula, F. E. Bustamante, and P. Casas. Anycast on the move: A look at mobile anycast performance. In Proc. TMA, 2018.

[57]

D. Wu, R. K. C. Chang, W. Li, E. K. T. Cheng, and D. Gao. MopEye: Opportunistic monitoring of per-app mobile network performance. In Proc. USENIX Annual Technical Conference (ATC), pages 445--457, 2017.

Digital Library

[58]

Q. Xu, J. Huang, Z. Wang, F. Qian, A. Gerber, and Z. M. Mao. Cellular data network infrastructure characterization and implication on mobile content placement. In Proc. ACM SIGMETRICS, 2011.

Digital Library

[59]

H. Yan, A. Flavel, Z. Ge, A. Gerber, D. Massey, C. Papadopoulos, H. Shah, and J. Yates. Argus: End-to-end service anomaly detection and localization from an ISP's point of view. In Proc. IEEE INFOCOM, 2012.

Cited By

Zhang ZMarder AMok RHuffaker BLuckie MClaffy KSchulman ALevin DMislove AAmann JLuckie M(2021)Inferring regional access network topologiesProceedings of the 21st ACM Internet Measurement Conference10.1145/3487552.3487812(720-738)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3487552.3487812
Fu JWang YZhou YWang X(2021)How resource utilization influences UI responsiveness of Android softwareInformation and Software Technology10.1016/j.infsof.2021.106728(106728)Online publication date: Sep-2021
https://doi.org/10.1016/j.infsof.2021.106728
Agarwal NVarvello MAucinas ABustamante FNetravali RHan DFeldmann A(2020)Mind the delayProceedings of the 16th International Conference on emerging Networking EXperiments and Technologies10.1145/3386367.3431299(364-370)Online publication date: 23-Nov-2020
https://dl.acm.org/doi/10.1145/3386367.3431299

Recommendations

Xamarin Mobile Application Development: Cross-Platform C# and Xamarin. Forms Fundamentals
An Explorative Study of the Mobile App Ecosystem from App Developers' Perspective
WWW '17: Proceedings of the 26th International Conference on World Wide Web

With the prevalence of smartphones, app markets such as Apple App Store and Google Play has become the center stage in the mobile app ecosystem, with millions of apps developed by tens of thousands of app developers in each major market. This paper ...
A Measurement-based Study on Application Popularity in Android and iOS App Stores
Mobidata '15: Proceedings of the 2015 Workshop on Mobile Big Data

Mobile application stores (appstores) are emerging digital distribution platforms with explosive growth. Although there have been some observations on the mobile application (app) popularity in Android appstores, there is no report on the app popularity ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

IWQoS '19: Proceedings of the International Symposium on Quality of Service

June 2019

420 pages

ISBN:9781450367783

DOI:10.1145/3326285

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

NSFC

Conference

IWQoS '19

IWQoS '19: IEEE/ACM International Symposium on Quality of Service

June 24 - 25, 2019

Arizona, Phoenix

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
170
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang ZMarder AMok RHuffaker BLuckie MClaffy KSchulman ALevin DMislove AAmann JLuckie M(2021)Inferring regional access network topologiesProceedings of the 21st ACM Internet Measurement Conference10.1145/3487552.3487812(720-738)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3487552.3487812
Fu JWang YZhou YWang X(2021)How resource utilization influences UI responsiveness of Android softwareInformation and Software Technology10.1016/j.infsof.2021.106728(106728)Online publication date: Sep-2021
https://doi.org/10.1016/j.infsof.2021.106728
Agarwal NVarvello MAucinas ABustamante FNetravali RHan DFeldmann A(2020)Mind the delayProceedings of the 16th International Conference on emerging Networking EXperiments and Technologies10.1145/3386367.3431299(364-370)Online publication date: 23-Nov-2020
https://dl.acm.org/doi/10.1145/3386367.3431299

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents