More Web Proxy on the site http://driver.im/

research-article

Open access

Performance of Cellular Networks on the Wheels

Authors:

Moinak Ghoshal,

Dimitrios KoutsonikolasAuthors Info & Claims

IMC '23: Proceedings of the 2023 ACM on Internet Measurement Conference

Pages 678 - 695

https://doi.org/10.1145/3618257.3624814

Published: 24 October 2023 Publication History

Abstract

After 4 years of rapid deployment in the US, 5G is expected to have significantly improved the performance and overall user experience of mobile networks. However, recent measurement studies have focused either on static performance or a single aspect (e.g., handovers) under driving conditions of 5G, and do not provide a complete picture of cellular network performance today under driving conditions - a major use case of mobile networks. Through a cross-continental US driving trip (from LA to Boston, 5700km+), we conduct an in-depth measurement study of user-perceived experience (network coverage/performance and QoE of a set of major latency-critical 5G "killer'' apps) To understand the root cause of the observed network performance, while collecting low-level 5G statistics and signaling messages. Our study shows disappointingly low coverage of 5G networks today under driving and highly fragmented coverage by cellular technologies. More importantly, network and application performance are often poor under driving even in areas with full 5G coverage. We also examine the correlation of technology-wise coverage and performance with geo-location and the vehicle's speed and analyze the impact of a number of lower layer KPIs on network performance.

References

[1]

2016. Americans Spend 293 Hours Driving Each Year. https://www.automotive- fleet.com/136735/americans-spend-an-average-of-17-600-minutes-driving-annually

[2]

2020. TensorFlow Android Camera Demo. https://github.com/tensorflow/ tensorflow/tree/48a2944c94b190434418d5a7c7f0df452c3aded5/tensorflow/ examples/android

[3]

2022. USA 5G Experience Report JULY 2022. https://www.opensignal.com/ reports/2022/07/usa/mobile-network-experience-5g

[4]

2022. Verizon 5G Ultra Wideband expected to cover 175 million people by the end of 2022. https://www.verizon.com/about/news/verizon-5g-ultra-wideband-175-million-people-2022

[5]

Online. Counter-Strike: Global Offensive. https://store.steampowered.com/app/ 730/CounterStrike_Global_Offensive/

[6]

Online. FFmpeg Project. (2022). Retrieved January 2022 from. https://ffmpeg.org/

[7]

Online. Hitman 2: Silent Assassin. https://store.steampowered.com/app/6850/ Hitman_2_Silent_Assassin/

[8]

Online. [IMC '23] Performance of Cellular Networks on the Wheels. https://github.com/NUWiNS/imc2023-cellular-network-performance-on- wheels-data.

[9]

Online. nPerf. https://www.nperf.com/en/

[10]

Online. nuttcp - Network Performance Measurement Tool. https://www.nuttcp.net

[11]

Online. OpenSignal. https://www.opensignal.com/

[12]

Online. SpeedTest by Ookla. https://www.speedtest.net/

[13]

Online. Speedtest Global Index: Ranking mobile and fixed broadband speeds from around the world on a monthly basis. https://www.speedtest.net/global-index/united-states?mobile#market-analysis

[14]

Online. Steam Link App. https://store.steampowered.com/app/353380/Steam_ Link/

[15]

Online. Steam Remote Play. https://store.steampowered.com/remoteplay

[16]

3GPP. 2019. 3GPP.2019. Release 15. https://www.3gpp.org/release-15

[17]

accuverxcalsolo [n. d.]. XCAL Solo. https://accuver.com/sub/products/view.php? idx=11;.

[18]

awsWavelength [n. d.]. What is AWS Wavelength? https://docs.aws.amazon. com/wavelength/latest/developerguide/what-is-wavelength.html.

[19]

Ali J. Ben Ali, Zakieh Sadat Hashemifar, and Karthik Dantu. 2020. Edge-SLAM: Edge-Assisted Visual Simultaneous Localization and Mapping. (2020).

[20]

CableLabs. 2019. 5G Link Aggregation with Multipath TCP (MPTCP). https: //www.cablelabs.com/5g-link-aggregation-mptcp.

[21]

Ming-Fang Chang, John Lambert, Patsorn Sangkloy, Jagjeet Singh, Slawomir Bak, Andrew Hartnett, De Wang, Peter Carr, Simon Lucey, Deva Ramanan, and James Hays. 2019. Argoverse: 3D Tracking and Forecasting With Rich Maps. In Proc. of CVPR.

[22]

Tiffany Yu-Han Chen, Lenin Ravindranath, Shuo Deng, Paramvir Bahl, and Hari Balakrishnan. 2015. Glimpse: Continuous, real-time object recognition on mobile devices. In Proc. of ACM SenSys.

[23]

Haotian Deng, Chunyi Peng, Ans Fida, Jiayi Meng, and Y Charlie Hu. 2018. Mobility support in cellular networks: A measurement study on its configurations and implications. In Proc. of ACM IMC.

Digital Library

[24]

Phuc Dinh, Moinak Ghoshal, Dimitrios Koutsonikolas, and Joerg Widmer. 2022. Demystifying Resource Allocation Policies in Operational 5G mmWave Networks. In Proc. of IEEE WoWMoM.

[25]

Moinak Ghoshal, Z. Jonny Kong, Qiang Xu, Zixiao Lu, Shivang Aggarwal, Imran Khan, Yuanjie Li, Y. Charlie Hu, and Dimitrios Koutsonikolas. 2022. An In-Depth Study of Uplink Performance of 5G MmWave Networks. In Proc. of the ACM SIGCOMM 5G-MeMU Workshop.

Digital Library

[26]

Ahmad Hassan, Arvind Narayanan, Anlan Zhang, Wei Ye, Ruiyang Zhu, Shuowei Jin, Jason Carpenter, Z Morley Mao, Feng Qian, and Zhi-Li Zhang. 2022. Vivisect- ing mobility management in 5G cellular networks. In Proc. of ACM SIGCOMM.

[27]

Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proc. of ACM SIGCOMM.

Digital Library

[28]

killerapp5g [n. d.]. 5G: Is There a Killer ?App" on the Loose? https://drivenets. com/blog/industry-outlook/5g-is-there-a-killer-app-on-the-loose/.

[29]

Konstantinos Kousias, Mohammad Rajiullah, Giuseppe Caso, Ozgu Alay, Anna Brunstorm, Luca De Nardis, Marco Neri Usman Ali, and Maria-Gabriella Di Benedetto. 2022. Implications of Handover Events in commercial 5G Non- Standalone Deployments in Rome. In Proc. of ACM 5G-MeMU.

Digital Library

[30]

Konstantinos Kousias, Mohammad Rajiullah, Giuseppe Caso, Ozgu Alay, Anna Brunstorm, Luca De Nardis, Marco Neri, Usman Ali, and Maria-Gabriella Di Benedetto. 2022. Coverage and Performance Analysis of 5G Non-Standalone Deployments. In Proc. of ACM WiNTECH.

Digital Library

[31]

HyunJong Lee, Jason Flinn, and Basavaraj Tonshal. 2018. RAVEN: Improving Interactive Latency for the Connected Car. In Proc. of ACM MobiCom.

Digital Library

[32]

Shih-Chieh Lin, Yunqi Zhang, Chang-Hong Hsu, Matt Skach, Md E Haque, Lingjia Tang, and Jason Mars. 2018. The architectural implications of autonomous driving: Constraints and acceleration. In Proc. of ACM ASPLOS.

Digital Library

[33]

Luyang Liu, Hongyu Li, and Marco Gruteser. 2019. Edge assisted real-time object detection for mobile augmented reality. In Proc. of ACM MobiCom.

Digital Library

[34]

Keith Mallinson. 2022. Revenue boost for automotive industry from cellular connectivity outweighs SEP licensing costs (Analyst Angle). https://tinyurl. com/2cu3tm2m

[35]

Jiayi Meng, Zhaoning Kong, Qiang Xu, and Y Charlie Hu. 2021. Do Larger (More Accurate) Deep Neural Network Models Help in Edge-assisted Augmented Reality?. In Proc. of ACM SIGCOMM NAI Workshop.

Digital Library

[36]

Jiayi Meng, Z. Jonny Kong, Y Charlie Hu, Mun Gi Choi, and Dhananjay Lal. 2022. Do We Need Sophisticated System Design for Edge-assisted Augmented Reality?. In Proc. of ACM EdgeSys.

Digital Library

[37]

Arvind Narayanan, Eman Ramadan, Jason Carpenter, Qingxu Liu, Yu Liu, Feng Qian, and Zhi-Li Zhang. 2020. A first look at commercial 5G performance on smartphones. In Proc. of ACM WWW.

Digital Library

[38]

Arvind Narayanan, Eman Ramadan, Rishabh Mehta, Xinyue Hu, Qingxu Liu, Rostand AK Fezeu, Udhaya Kumar Dayalan, Saurabh Verma, Peiqi Ji, Tao Li, et al. 2020. Lumos5G: Mapping and predicting commercial mmWave 5G throughput. In Proc. of ACM IMC.

Digital Library

[39]

Arvind Narayanan, Eman Ramadan, Jacob Quant, Peiqi Ji, Feng Qian, and Zhi-Li Zhang. 2020. 5G Tracker - A Crowdsourced Platform to Enable Research Using Commercial 5G Services. In Poster, Proc. of ACM SIGCOMM.

[40]

Arvind Narayanan, Muhammad Iqbal Rochman, Ahmad Hassan, Bariq S Firmansyah, Vanlin Sathya, Monisha Ghosh, Feng Qian, and Zhi-Li Zhang. 2022. A comparative measurement study of commercial 5G mmwave deployments. In Proc. of IEEE INFOCOM.

Digital Library

[41]

Arvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan, Shuowei Jin, Xiao Zhu, Xiaoxuan Zhang, Denis Rybkin, Zhengxuan Yang, Zhuoqing Morley Mao, Feng Qian, and Zhi-Li Zhang. 2021. A Variegated Look at 5G in the Wild: Performance, Power, and QoE Implications. In Proc. of ACM SIGCOMM.

Digital Library

[42]

Yunzhe Ni, Feng Qian, Taide Liu, Yihua Cheng, Zhiyao Ma, Jing Wang, Zhongfeng Wang, Gang Huang, Xuanzhe Liu, and Chenren Xu. 2023. POLYCORN: Data-driven Cross-layer Multipath Networking for High-speed Railway through Com- posable Schedulerlets. In Proc. of USENIX NSDI.

[43]

Paniz Parastar, Andra Lutu Ozg Ozgu Alay, Giuseppe Caso, and Diego Perino. 2023. Spotlight on 5G: Performance, Device Evolution and Challenges from a Mobile Operator Perspective. In Proc. of IEEE INFOCOM.

[44]

Hang Qiu, Fawad Ahmad, Fan Bai, Marco Gruteser, and Ramesh Govindan. 2018. AVR: Augmented Vehicular Reality. In Proc. of ACM MobiCom.

Digital Library

[45]

Hang Qiu, Po-Han Huang, Namo Asavisanu, Xiaochen Liu, Konstantinos Psounis, and Ramesh Govindan. 2022. AutoCast: Scalable Infrastructure-less Cooperative Perception for Distributed Collaborative Driving. In Proc. of ACM MobiSys.

Digital Library

[46]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards Real-time Object Detection with Region Proposal Networks. In Proc. of NeurlIPS.

[47]

Shuyao Shi, Jiahe Cui, Zhehao Jiang, Zhenyu Yan, Guoliang Xing, Jianwei Niu, and Zhenchao Ouyang. 2022. VIPS: Real-time Perception Fusion for Infrastructure-assisted Autonomous Driving. In Proc. of ACM MobiCom.

Digital Library

[48]

Jing Wang, Yufan Zheng, Yunzhe Ni, Chenren Xu, Feng Qian, Wangyang Li, Wantong Jiang, Yihua Cheng, Zhuo Cheng, Yuanjie Li, et al. 2019. An active- passive measurement study of tcp performance over lte on high-speed rails. In Proc. of ACM MobiCom.

Digital Library

[49]

Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020. Understanding operational 5G: A first measurement study on its coverage, performance and energy consumption. In Proc. of ACM SIGCOMM.

Digital Library

[50]

Shichang Xu, Ashkan Nikravesh, and Z. Morley Mao. [n. d.]. Leveraging Context- Triggered Measurements to Characterize LTE Handover Performance. In In Proc. of PAM 2019.

Digital Library

[51]

Francis Y. Yan, Hudson Ayers, Chenzhi Zhu, Sadjad Fouladi, James Hong, Keyi Zhang, Philip Levis, and Keith Winstein. 2020. Learning in situ: A Randomized Experiment in Video Streaming. In Proc. of USENIX NSDI.

[52]

Xinlei Yang, Hao Lin, Zhenhua Li, Feng Qian, Xingyao Li, Zhiming He, Xudong Wu, Xianlong Wang, Yunhao Liu, Zhi Liao, et al. 2022. Mobile access bandwidth in practice: Measurement, analysis, and implications. In Proc. of ACM SIGCOMM.

Digital Library

[53]

Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control- Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proc. of ACM SIGCOMM.

Digital Library

[54]

Xumiao Zhang, Anlan Zhang, Jiachen Sun, Xiao Zhu, Y Ethan Guo, Feng Qian, and Z Morley Mao. 2021. EMP: Edge-assisted Multi-vehicle Perception. In Proc. of ACM MobiCom.

Digital Library

[55]

Zhehui Zhang, Yuanjie Li, Qianru Li, Jinghao Zhao, Ghufran Baig, Lili Qiu, and Songwu Lu. 2022. Movement-Based Reliable Mobility Management for Beyond 5G Cellular Networks. IEEE/ACM ToN (2022).

[56]

Zhang, Wuyang and He, Zhezhi and Liu, Luyang and Jia, Zhenhua and Liu, Yunxin and Gruteser, Marco and Raychaudhuri, Dipankar and Zhang, Yanyong. 2021. ELF: Accelerate High-resolution Mobile Deep Vision with Content-aware Parallel Offloading. In Proc. of ACM MobiCom.

Cited By

Hu JWang LWu JPei QLiu FLi B(2025)A comparative measurement study of cross-layer 5G performance under different mobility scenariosComputer Networks10.1016/j.comnet.2024.110952257(110952)Online publication date: Feb-2025
https://doi.org/10.1016/j.comnet.2024.110952
Khan IGhoshal MAngjo JDimce SHussain MParastar PYu YFiandrino COrfanidis CAggarwal SAguiar AAlay OChiasserini CDressler FHu YKo SKoutsonikolas DWidmer J(2024)How Mature is 5G Deployment? A Cross-Sectional, Year-Long Study of 5G Uplink Performance2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619877(276-284)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619877
K. Fezeu RFiandrino CRamadan ECarpenter Jde Freitas LBilal FYe WWidmer JQian FZhang ZSekar VYu MSeneviratne AVeitch D(2024)Unveiling the 5G Mid-Band Landscape: From Network Deployment to Performance and Application QoEProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672269(358-372)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672269
Show More Cited By

Index Terms

Performance of Cellular Networks on the Wheels
1. Networks
  1. Network performance evaluation
    1. Network measurement
  2. Network types
    1. Mobile networks

Recommendations

Vivisecting mobility management in 5G cellular networks
SIGCOMM '22: Proceedings of the ACM SIGCOMM 2022 Conference

With 5G's support for diverse radio bands and different deployment modes, e.g., standalone (SA) vs. non-standalone (NSA), mobility management - especially the handover process - becomes far more complex. Measurement studies have shown that frequent ...
Anatomizing application performance differences on smartphones
MobiSys '10: Proceedings of the 8th international conference on Mobile systems, applications, and services

The use of cellular data networks is increasingly popular due to the widespread deployment of 3G technologies and the rapid adoption of smartphones, such as iPhone and GPhone. Besides email and web browsing, a variety of network applications are now ...
Performance issues and solutions in SDN-based data center: a survey
Abstract
Due to the development of the Internet and the smart end systems such as smartphones, portable laptop, and other smart mobile devices, as well as the emergence of concepts such as cloud computing, social networks, and Internet of Things, 4G and 5G ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '23: Proceedings of the 2023 ACM on Internet Measurement Conference

October 2023

746 pages

ISBN:9798400703829

DOI:10.1145/3618257

General Chairs:
Marie-José Montpetit
McGill University, Canada
,
Aris Leivadeas
École de Technologie Supérieure, Canada
,
Program Chairs:
Steve Uhlig
Queen Mary University of London, United Kingdom
,
Mobin Javed
Lahore University of Management Sciences, Pakistan

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF

Conference

IMC '23

Sponsor:

SIGCOMM

IMC '23: ACM Internet Measurement Conference

October 24 - 26, 2023

Montreal QC, Canada

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
1,098
Total Downloads

Downloads (Last 12 months)884
Downloads (Last 6 weeks)94

Reflects downloads up to 24 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hu JWang LWu JPei QLiu FLi B(2025)A comparative measurement study of cross-layer 5G performance under different mobility scenariosComputer Networks10.1016/j.comnet.2024.110952257(110952)Online publication date: Feb-2025
https://doi.org/10.1016/j.comnet.2024.110952
Khan IGhoshal MAngjo JDimce SHussain MParastar PYu YFiandrino COrfanidis CAggarwal SAguiar AAlay OChiasserini CDressler FHu YKo SKoutsonikolas DWidmer J(2024)How Mature is 5G Deployment? A Cross-Sectional, Year-Long Study of 5G Uplink Performance2024 IFIP Networking Conference (IFIP Networking)10.23919/IFIPNetworking62109.2024.10619877(276-284)Online publication date: 3-Jun-2024
https://doi.org/10.23919/IFIPNetworking62109.2024.10619877
K. Fezeu RFiandrino CRamadan ECarpenter Jde Freitas LBilal FYe WWidmer JQian FZhang ZSekar VYu MSeneviratne AVeitch D(2024)Unveiling the 5G Mid-Band Landscape: From Network Deployment to Performance and Application QoEProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672269(358-372)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672269
Ye WHu XSleder SZhang ADayalan UHassan AFezeu RJajoo ALee MRamadan EQian FZhang ZSekar VYu MSeneviratne AVeitch D(2024)Dissecting Carrier Aggregation in 5G Networks: Measurement, QoE Implications and PredictionProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672250(340-357)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672250
Kalntis MSuárez-Varela JIglesias JBhattacharjee AIosifidis GKuipers FLutu AVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Through the Telco Lens: A Countrywide Empirical Study of Cellular HandoversProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688452(51-67)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688452
Ghoshal MMohanti SKoutsonikolas D(2024)Enabling Emerging Applications in 5G Through UE-Assisted Proactive PHY Frame Configuration2024 IEEE 35th International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC)10.1109/PIMRC59610.2024.10817441(1-7)Online publication date: 2-Sep-2024
https://doi.org/10.1109/PIMRC59610.2024.10817441
Caso GRajiullah MKousias KAli UBouzar NNardis LBrunstrom AAlay ONeri MBenedetto M(2024)The Chronicles of 5G Non-Standalone: An Empirical Analysis of Performance and Service EvolutionIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34993705(7380-7399)Online publication date: 2024
https://doi.org/10.1109/OJCOMS.2024.3499370
Qi SRamakrishnan KChen J(2024)L²6GC: Evolving the Low-Latency Core for Future Cellular NetworksIEEE Internet Computing10.1109/MIC.2024.337665528:2(29-36)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1109/MIC.2024.3376655
Basit ODinh PKhan IKong ZHu YKoutsonikolas DLee MLiu C(2024)On the Predictability of Fine-Grained Cellular Network Throughput Using Machine Learning Models2024 IEEE 21st International Conference on Mobile Ad-Hoc and Smart Systems (MASS)10.1109/MASS62177.2024.00018(47-56)Online publication date: 23-Sep-2024
https://doi.org/10.1109/MASS62177.2024.00018
Mallik AChen DHan KXie JHan Z(2024)Unleashing the True Power of Age-of-Information: Service Aggregation in Connected and Autonomous VehiclesICC 2024 - IEEE International Conference on Communications10.1109/ICC51166.2024.10622247(1709-1714)Online publication date: 9-Jun-2024
https://doi.org/10.1109/ICC51166.2024.10622247
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten