[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3658644.3690370acmconferencesArticle/Chapter ViewAbstractPublication PagesccsConference Proceedingsconference-collections
research-article

Watch the Rhythm: Breaking Privacy with Accelerometer at the Extremely-Low Sampling Rate of 5Hz

Published: 09 December 2024 Publication History

Abstract

Considering the threat from on-board eavesdropping with smartphone motion sensors, Android 12 has limited the maximum sampling rate of motion sensors to 200Hz for zero-privilege access to prevent potential wiretapping. Unfortunately, there have been some attacks targeting 200Hz, making it not a safe sampling rate any more. Smartphone manufacturers may further reduce the maximum sampling rate of the accelerometer in response to this privacy concern. It can be expected that, the maximum sampling rate will gradually decrease to a very low level, as the battle between manufacturers and adversaries continues. Existing on-board eavesdropping approaches, utilizing spectral features, cannot provide acceptable accuracy at very low sampling rates, not even at 50Hz.
Therefore, this paper explores the feasibility of using the on-board accelerometer for privacy breaking with an extremely-low sampling rate, specifically, 5Hz. 5Hz is a minimum sampling rate to meet normal use, otherwise the applications can only choose to work without the accelerometer. Since the lowest fundamental frequency for humans is around 85Hz, such a low sampling rate poses a significant challenge for sound recognition. According to Nyquist's law, it seems impossible to capture 85Hz with the sampling rate of 5Hz. Fortunately, we observe that the rhythm features, including pause rhythm and intensity rhythm, of accelerometer data are relatively stable at various sampling rates. On this basis, we propose an eavesdropping approach with the accelerometer at an extremely-low sampling rate. Introducing the rhythm features, we achieve an accuracy of 95.09% at 50Hz and 78.66% at 5Hz for scene recognition. The accuracy is 90.60% at 50Hz and 47% at 5Hz for Chinese digits recognition, plus 96.63% at 50Hz and 58.67% at 5Hz for popular Chinese cities recognition. Furthermore, we achieve determination for typical places like bar, metro, bus, car, and quiet room, by analyzing the vibration of surroundings, with an average accuracy of 91.28%. Combining place determination with eavesdropping, our approach poses a serious threat to personal privacy. Since 5Hz is generally used for screen orientation detection, our attack can hide in any kind of application, not just in game or sport applications. We also suggest some countermeasures.

References

[1]
2020. Eaves. https://github.com/miligithub/Eaves
[2]
2024. Bixby. https://www.samsung.com/us/support/answer/ANS00076751/
[3]
2024. SensorManager. https://developer.android.google.cn/reference/android/ hardware/SensorManager
[4]
Ahmed Al-Haiqi, Mahamod Ismail, and Rosdiadee Nordin. 2013. On the best sensor for keystrokes inference attack on android. Procedia Technology 11 (2013), 989--995.
[5]
Heba Aly and Moustafa Youssef. 2016. Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones. In IEEE INFOCOM 2016-The 35th Annual IEEE International Conference on Computer Communications. IEEE, 1--9.
[6]
S Abhishek Anand and Nitesh Saxena. 2018. Speechless: Analyzing the threat to speech privacy from smartphone motion sensors. In 2018 IEEE Symposium on Security and Privacy (SP). IEEE, 1000--1017.
[7]
S Abhishek Anand, Chen Wang, Jian Liu, Nitesh Saxena, and Yingying Chen. 2021. Spearphone: a lightweight speech privacy exploit via accelerometer-sensed reverberations from smartphone loudspeakers. In Proceedings of the 14th ACM Conference on Security and Privacy in Wireless and Mobile Networks. 288--299.
[8]
Alvina Anjum and Muhammad U Ilyas. 2013. Activity recognition using smartphone sensors. In 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC). IEEE, 914--919.
[9]
Zhongjie Ba, Tianhang Zheng, Xinyu Zhang, Zhan Qin, Baochun Li, Xue Liu, and Kui Ren. 2020. Learning-based Practical Smartphone Eavesdropping with Built-in Accelerometer. In Network and Distributed System Security Symposium (NDSS), Vol. 2020. 1--18.
[10]
Sören Becker, Marcel Ackermann, Sebastian Lapuschkin, Klaus-Robert Müller, and Wojciech Samek. 2018. Interpreting and explaining deep neural networks for classification of audio signals. arXiv preprint arXiv:1807.03418 (2018), 1--6.
[11]
Liang Cai and Hao Chen. 2011. TouchLogger: Inferring Keystrokes on Touch Screen from Smartphone Motion. In 6th USENIX Workshop on Hot Topics in Security (HotSec 11). 1--6.
[12]
Sorin V Dusan, Esge B Andersen, Aram Lindahl, and Andrew P Bright. 2016. System and method of detecting a user?s voice activity using an accelerometer. US Patent 9,438,985.
[13]
Philip Eisenberg and Howard A Chinn. 1945. Tonal range and volume level preferences of broadcast listeners. Journal of Experimental Psychology 35, 5 (1945), 374.
[14]
Zakery Fyke, Isaac Griswold-Steiner, and Abdul Serwadda. 2019. Prying into private spaces using mobile device motion sensors. In 2019 17th International Conference on Privacy, Security and Trust (PST). IEEE, 1--10.
[15]
Ming Gao, Yajie Liu, Yike Chen, Yimin Li, Zhongjie Ba, Xian Xu, Jinsong Han, and Kui Ren. 2022. Device-independent smartphone eavesdropping jointly using accelerometer and gyroscope. IEEE Transactions on Dependable and Secure Computing 20, 4 (2022), 3144--3157.
[16]
Xin Gao, Jie Tian, and Guiling Wang. 2014. Poster: detection of transportation mode based on smartphones for reducing distracted driving. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking. 355--358.
[17]
Jun Han, Albert Jin Chung, and Patrick Tague. 2017. Pitchln: eavesdropping via intelligible speech reconstruction using non-acoustic sensor fusion. In Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks. 181--192.
[18]
Jun Han, Emmanuel Owusu, Le T Nguyen, Adrian Perrig, and Joy Zhang. 2012. Accomplice: Location inference using accelerometers on smartphones. In 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012). IEEE, 1--9.
[19]
Samuli Hemminki, Petteri Nurmi, and Sasu Tarkoma. 2013. Accelerometer-based transportation mode detection on smartphones. In Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems. 1--14.
[20]
Duncan Hodges and Oliver Buckley. 2018. Reconstructing what you said: Text inference using smartphone motion. IEEE Transactions on Mobile Computing 18, 4 (2018), 947--959.
[21]
Pengfei Hu, Hui Zhuang, Panneer Selvam Santhalingam, Riccardo Spolaor, Parth Pathak, Guoming Zhang, and Xiuzhen Cheng. 2022. Accear: Accelerometer acoustic eavesdropping with unconstrained vocabulary. In 2022 IEEE Symposium on Security and Privacy (SP). IEEE, 1757--1773.
[22]
Jingyu Hua, Zhenyu Shen, and Sheng Zhong. 2016. We can track you if you take the metro: Tracking metro riders using accelerometers on smartphones. IEEE Transactions on Information Forensics and Security 12, 2 (2016), 286--297.
[23]
Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. 2011. Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter 12, 2 (2011), 74--82.
[24]
Gierad Laput, Robert Xiao, and Chris Harrison. 2016. Viband: High-fidelity bioacoustic sensing using commodity smartwatch accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 321--333.
[25]
Fan Li, Chunshui Zhao, Guanzhong Ding, Jian Gong, Chenxing Liu, and Feng Zhao. 2012. A reliable and accurate indoor localization method using phone inertial sensors. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. 421--430.
[26]
Xiang-Yang Li, Huiqi Liu, Lan Zhang, ZhenanWu, Yaochen Xie, Ge Chen, Chunxiao Wan, and Zhongwei Liang. 2019. Finding the stars in the fireworks: Deep understanding of motion sensor fingerprint. IEEE/ACM Transactions on Networking 27, 5 (2019), 1945--1958.
[27]
Philip Marquardt, Arunabh Verma, Henry Carter, and Patrick Traynor. 2011. (sp) iphone: Decoding vibrations from nearby keyboards using mobile phone accelerometers. In Proceedings of the 18th ACM Conference on Computer and Communications Security. 551--562.
[28]
Henar Martín, Ana M Bernardos, Josué Iglesias, and José R Casar. 2013. Activity logging using lightweight classification techniques in mobile devices. Personal and Ubiquitous Computing 17 (2013), 675--695.
[29]
Aleksandar Matic, Venet Osmani, and Oscar Mayora. 2012. Speech activity detection using accelerometer. In 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 2112--2115.
[30]
Richard Matovu, Isaac Griswold-Steiner, and Abdul Serwadda. 2019. Kinetic song comprehension: Deciphering personal listening habits via phone vibrations. arXiv preprint arXiv:1909.09123 (2019), 1--25.
[31]
Harry Nyquist. 1928. Certain topics in telegraph transmission theory. Transactions of the American Institute of Electrical Engineers 47, 2 (1928), 617--644.
[32]
Emmanuel Owusu, Jun Han, Sauvik Das, Adrian Perrig, and Joy Zhang. 2012. Accessory: password inference using accelerometers on smartphones. In proceedings of the twelfth Workshop on Mobile Computing Systems & Applications. 1--6.
[33]
Abhinav Parate, Meng-Chieh Chiu, Chaniel Chadowitz, Deepak Ganesan, and Evangelos Kalogerakis. 2014. Risq: Recognizing smoking gestures with inertial sensors on a wristband. In Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services. 149--161.
[34]
Elangovan Ramanujam, Thinagaran Perumal, and S Padmavathi. 2021. Human activity recognition with smartphone and wearable sensors using deep learning techniques: A review. IEEE Sensors Journal 21, 12 (2021), 13029--13040.
[35]
Muhammad Shoaib, Hans Scholten, and Paul JM Havinga. 2013. Towards physical activity recognition using smartphone sensors. In 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing. IEEE, 80--87.
[36]
Praveen Kumar Shukla, Ankit Vijayvargiya, Rajesh Kumar, et al. 2020. Human activity recognition using accelerometer and gyroscope data from smartphones. In 2020 International Conference on Emerging Trends in Communication, Control and Computing (ICONC3). IEEE, 1--6.
[37]
V SN and D B IV. 1963. Mathematische Statistik in der Technik. Deutscher Verl. der Wissenschaften (1963), 111--126.
[38]
Ke Sun, Chunyu Xia, Songlin Xu, and Xinyu Zhang. 2023. StealthyIMU: Stealing Permission-protected Private Information From Smartphone Voice Assistant Using Zero-Permission Sensors. In Network and Distributed System Security Symposium( NDSS'23). 1--16.
[39]
Benxiao Tang, ZhiboWang, RunWang, Lei Zhao, and LinaWang. 2018. Niffler: A Context-Aware and User-Independent Side-Channel Attack System for Password Inference. Wireless Communications and Mobile Computing 2018, 1 (2018), 1--20.
[40]
Chen Wang, Xiaonan Guo, Yan Wang, Yingying Chen, and Bo Liu. 2016. Friend or foe? Your wearable devices reveal your personal pin. In Proceedings of the 11th ACM on Asia Conference on Computer and Communications Security. 189--200.
[41]
Dong Wang and Xuewei Zhang. 2015. Thchs-30: A free chinese speech corpus. arXiv preprint arXiv:1512.01882 (2015).
[42]
He Wang, Ted Tsung-Te Lai, and Romit Roy Choudhury. 2015. Mole: Motion leaks through smartwatch sensors. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 155--166.
[43]
Wanmin Wu, Sanjoy Dasgupta, Ernesto E Ramirez, Carlyn Peterson, Gregory J Norman, et al. 2012. Classification accuracies of physical activities using smartphone motion sensors. Journal of Medical Internet Research 14, 5 (2012), e2208.
[44]
Zhi Xu, Kun Bai, and Sencun Zhu. 2012. Taplogger: Inferring user inputs on smartphone touchscreens using on-board motion sensors. In Proceedings of the fifth ACM Conference on Security and Privacy in Wireless and Mobile Networks. 113--124.
[45]
Li Zhang, Parth H Pathak, Muchen Wu, Yixin Zhao, and Prasant Mohapatra. 2015. Accelword: Energy efficient hotword detection through accelerometer. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. 301--315.

Index Terms

  1. Watch the Rhythm: Breaking Privacy with Accelerometer at the Extremely-Low Sampling Rate of 5Hz

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CCS '24: Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security
      December 2024
      5188 pages
      ISBN:9798400706363
      DOI:10.1145/3658644
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 09 December 2024

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. extremely-low sampling rate
      2. on-board eavesdropping
      3. rhythm features
      4. side-channel attack

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      CCS '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,261 of 6,999 submissions, 18%

      Upcoming Conference

      CCS '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 114
        Total Downloads
      • Downloads (Last 12 months)114
      • Downloads (Last 6 weeks)85
      Reflects downloads up to 26 Jan 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media