More Web Proxy on the site http://driver.im/

research-article

Sensing multimedia contexts on mobile devices

Authors:

Mohammad A. Hoque,

Abhishek Kumar,

Sasu TarkomaAuthors Info & Claims

NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

Pages 40 - 46

https://doi.org/10.1145/3386290.3396935

Published: 08 June 2020 Publication History

Abstract

We use various multimedia applications on smart devices to consume multimedia content, to communicate with our peers, and to broadcast our events live. This paper investigates the utilization of different media input/output devices, e.g., camera, microphone, and speaker, by different types of multimedia applications, and introduces the notion of multimedia context. Our measurements lead to a sensing algorithm called MediaSense, which senses the states of multiple I/O devices and identifies eleven multimedia contexts of a mobile device in real time. The algorithm distinguishes stored content playback from streaming, live broadcasting from local recording, and conversational multimedia sessions from GSM/VoLTE calls on mobile devices.

References

[1]

Voice Over IP - Per Call Bandwidth Consumption. https://www.cisco.com/c/en/us/support/docs/voice/voice-quality/7934-bwidth-consume.html, 2016. Last Accessed: April 30, 2020.

[2]

Android AudioManager. https://developer.android.com/reference/android/media/AudioManager, 2018. Last Accessed: April 30, 2020.

[3]

Android AudioManager. https://developer.android.com/reference/android/telephony/TelephonyManager, 2018. Last Accessed: April 30, 2020.

[4]

Android CameraManager. https://developer.android.com/reference/android/hardware/camera2/CameraManager, 2018. Last Accessed: April 30, 2020.

[5]

Facebook Cambridge Analytica data scandal. https://en.wikipedia.org/wiki/Facebook-Cambridge_Analytica_data_scandal, 2018. Last Accessed: April 30, 2020.

[6]

Mixlr - Social Live Audio. https://play.google.com/store/apps/details?id=com.mixlr.android, 2018.

[7]

Perscope LIVE. https://www.periscope.tv, 2018.

[8]

TuneIn. https://tunein.com, 2018.

[9]

WhatsApp Messenger. https://www.whatsapp.com/android/, 2018.

[10]

YouTube. https://www.youtube.com, 2018.

[11]

2019--20 Coronavirus Pandemic. https://en.wikipedia.org/wiki/2019%E2%80%9320_coronavirus_pandemic, 2019. Last Accessed: April 30, 2020.

[12]

Nokia reveals impact of COVID-19 on network traffic. https://telecoms.com/503494/nokia-reveals-impact-of-covid-19-on-network-traffic/, 2020. Last Accessed: April 30, 2020.

[13]

YouTube throttling streaming quality globally as coronavirus forces people indoors. https://abcnews.go.com/Technology/netflix-youtube-throttle-streaming-quality-europe-coronavirus-forces/story?id=69754458, 2020. Last Accessed: April 30, 2020.

[14]

Athula Balachandran, Vyas Sekar, Aditya Akella, Srinivasan Seshan, Ion Stoica, and Hui Zhang. Developing a Predictive Model of Quality of Experience for Internet Video. In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM, SIGCOMM '13, pages 339--350, New York, NY, USA, 2013. ACM.

Digital Library

[15]

Lucia Ballard and Simon Cooper. What's New in Security? Apple wwdc16 session 706, 2016.

[16]

Dario Bonfiglio, Marco Mellia, Michela Meo, Dario Rossi, and Paolo Tofanelli. Revealing Skype Traffic: When Randomness Plays with You. SIGCOMM Comput. Commun. Rev., 37(4):37--48, August 2007.

Digital Library

[17]

Cisco. Cisco Visual Networking Index: Forecast and Methodology, 2016--2021. Technical report, 2017.

[18]

Bo Han, Pan Hui, V.S. Anil Kumar, Madhav V. Marathe, Guanhong Pei, and Aravind Srinivasan. Cellular Traffic Offloading through Opportunistic Communications: A Case Study. In Proceedings of the 5th ACM Workshop on Challenged Networks, CHANTS '10, page 31--38, New York, NY, USA, 2010. Association for Computing Machinery.

Digital Library

[19]

Dongbiao He, Cédric Westphal, and J. J. Garcia-Luna-Aceves. Network support for AR/VR and immersive video application: A survey. In Proceedings of the 15th International Joint Conference on e-Business and Telecommunications, ICETE 2018 - Volume 1: DCNET, ICE-B, OPTICS, SIGMAP and WINSYS, Porto, Portugal, July 26-28, 2018, pages 525--535. SciTePress, 2018.

[20]

Mohammad A. Hoque, Ashwin Rao, and Sasu Tarkoma. In Situ Network and Application Performance Measurement on Android Devices and the Imperfections, 2020. arXiv:2003.05208.

[21]

Mohammad A. Hoque, Matti Siekkinen, Jukka K. Nurminen, Mika Aalto, and Sasu Tarkoma. Mobile multimedia streaming techniques: QoE and energy saving perspective. Pervasive and Mobile Computing, 16:96 -- 114, 2015.

[22]

Junchen Jiang, Shijie Sun, Vyas Sekar, and Hui Zhang. Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), pages 393--406, Boston, MA, 2017. USENIX Association.

[23]

F. Karpisek, I. Baggili, and F. Breitinger. WhatsApp network forensics: Decrypting and understanding the WhatsApp call signaling messages. Digital Investigation, 15:110 -- 118, 2015. Special Issue: Big Data and Intelligent Data Analysis.

[24]

Feng Li, Jae Won Chung, and Mark Claypool. Silhouette: Identifying YouTube Video Flows from Encrypted Traffic. In Proceedings of the 28th ACM SIGMM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV '18, pages 19--24, New York, NY, USA, 2018. ACM.

[25]

Swadhin Pradhan, Sourav Kumar Dandapat, Niloy Ganguly, Bivas Mitra, and Pradipta De. Aggregating inter-app traffic to optimize cellular radio energy consumption on smartphones. In 7th International IEEE Conference on Communication Systems and Networks (COMSNETS), 2015, pages 1--8. IEEE, 2015.

[26]

Andrew Reed and Michael Kranch. Identifying HTTPS-Protected Netflix Videos in Real-Time. In Proceedings of the Seventh ACM on Conference on Data and Application Security and Privacy, CODASPY '17, pages 361--368, New York, NY, USA, 2017. ACM.

[27]

A. Schwind, F. Wamser, T. Gensler, P. Tran-Gia, M. Seufert, and P. Casas. Streaming Characteristics of Spotify Sessions. In 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX), pages 1--6, May 2018.

[28]

M. Siekkinen, M. A. Hoque, and J. K. Nurminen. Using Viewing Statistics to Control Energy and Traffic Overhead in Mobile Video Streaming. IEEE/ACM Transactions on Networking, 24(3):1489--1503, 2016.

Digital Library

[29]

M.A.K. Sudozai, Shahzad Saleem, William J. Buchanan, Nisar Habib, and Haleemah Zia. Forensics study of IMO call and chat app. Digital Investigation, 25:5 -- 23, 2018.

[30]

Alok Tongaonkar, Ram Keralapura, and Antonio Nucci. Challenges in Network Application Identification. In Presented as part of the 5th USENIX Workshop on Large-Scale Exploits and Emergent Threats, San Jose, CA, 2012. USENIX.

Digital Library

[31]

Primal Wijesekera, Arjun Baokar, Ashkan Hosseini, Serge Egelman, David Wagner, and Konstantin Beznosov. Android Permissions Remystiffed: A Field Study on Contextual Integrity. In 24th USENIX Security Symposium (USENIX Security 15), pages 499--514, Washington, D.C., 2015. USENIX Association.

[32]

Fengyuan Xu, Yunxin Liu, Thomas Moscibroda, Ranveer Chandra, Long Jin, Yongguang Zhang, and Qun Li. Optimizing background email sync on smart-phones. In Proceeding of the 11th annual international conference on Mobile systems, applications, and services, pages 55--68. ACM, 2013.

[33]

Wenxiao Zhang, Bo Han, and Pan Hui. On the networking challenges of mobile augmented reality. In Proceedings of the Workshop on Virtual Reality and Augmented Reality Network, pages 24--29, 2017.

Digital Library

Cited By

Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2023)Context-driven encrypted multimedia traffic classification on mobile devicesPervasive and Mobile Computing10.1016/j.pmcj.2022.10173788:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.pmcj.2022.101737
Venugopal JSubramanian APeatchimuthu J(2023)The realm of metaverse: A surveyComputer Animation and Virtual Worlds10.1002/cav.215034:5Online publication date: 2-Mar-2023
https://doi.org/10.1002/cav.2150
Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2022)Context-driven Encrypted Multimedia Traffic Classification on Mobile Devices2022 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom53586.2022.9762389(54-64)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerCom53586.2022.9762389

Index Terms

Sensing multimedia contexts on mobile devices

Recommendations

Mobile multimedia presentation editor: enabling creation of audio-visual stories on mobile devices
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A mobile device provides an attractive tool for creating and sharing audio-visual stories. Earlier research has shown that the users enjoy creating digital stories with their mobile devices. However, designing editor interfaces that support creation of ...
Accessing SMIL-based Dynamically Adaptable Multimedia Presentations from Mobile Devices
ITCC '04: Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'04) Volume 2 - Volume 2

Current business presentations are commonlymultimedia-based and with the realization of the mobileenterprise, accessing of such presentations stored onservers from mobile devices will become increasinglycommon. However as a roaming mobile device ...
Multimedia Services and Streaming for Mobile Devices: Challenges and Innovations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

NOSSDAV '20: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video

June 2020

73 pages

ISBN:9781450379458

DOI:10.1145/3386290

General Chair:
M. Reha Civanlar
Ozyegin University
,
Program Chairs:
Lucile Sassatelli
Universite Cote d'Azur
,
Jong-Seok Lee
Yonsei University

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 June 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Academy of Finland

Conference

MMSys '20

Sponsor:

SIGMM

MMSys '20: 11th ACM Multimedia Systems Conference

June 10 - 11, 2020

Istanbul, Turkey

Acceptance Rates

NOSSDAV '20 Paper Acceptance Rate 10 of 22 submissions, 45%;

Overall Acceptance Rate 118 of 363 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2023)Context-driven encrypted multimedia traffic classification on mobile devicesPervasive and Mobile Computing10.1016/j.pmcj.2022.10173788:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.pmcj.2022.101737
Venugopal JSubramanian APeatchimuthu J(2023)The realm of metaverse: A surveyComputer Animation and Virtual Worlds10.1002/cav.215034:5Online publication date: 2-Mar-2023
https://doi.org/10.1002/cav.2150
Hoque MFinley BRao AKumar AHui PAmmar MTarkoma S(2022)Context-driven Encrypted Multimedia Traffic Classification on Mobile Devices2022 IEEE International Conference on Pervasive Computing and Communications (PerCom)10.1109/PerCom53586.2022.9762389(54-64)Online publication date: 21-Mar-2022
https://doi.org/10.1109/PerCom53586.2022.9762389

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents