More Web Proxy on the site http://driver.im/

research-article

Safe audio AI services in smart buildings

Authors:

Jennifer Williams,

Vahid Yazdanpanah,

Sebastian SteinAuthors Info & Claims

BuildSys '22: Proceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

Pages 266 - 269

https://doi.org/10.1145/3563357.3564076

Published: 08 December 2022 Publication History

Abstract

Audio AI services present an opportunity to conceptualise smart buildings in a new light. Microphones can capture fine-grained audio information that can be used for determining how many people are inside of a building, where they are, and what kinds of activities are taking place. This information can feed into smart resource management systems or it could be used for assistive technologies. Generally speaking, audio is regarded as a less intrusive type of information collection than video surveillance, but significant issues of privacy and security persist with audio capture. Such issues warrant a serious discussion about how safe it is to use audio-capture in smart buildings for AI decision-making. This position paper initiates a discussion of research directions for the safety of audio services related to three key areas: data degradation strategies, dynamic customisation of tools, and privacy-aware technologies. In each area, we identify key challenges and highlight solution concepts with the potential to address the issue.

References

[1]

Masato Akagi and Yoshihiro Irie. 2012. Privacy Protection for Speech Based on Concepts of Auditory Scene Analysis. Proceedings of INTERNOISE (2012), 485.

[2]

Deeksha Anniappa and Yoohwan Kim. 2021. Security and Privacy Issues with Virtual Private Voice Assistants. In 2021 IEEE 11th Annual Computing and Communication Workshop and Conference (CCWC). 0702--0708.

[3]

Tom Backstrom, Andreas Nautsch, Karla Markert, and Ingo Siegert. 2021. How to collect speech data with human rights in mind. In Proceedings of 2021 ISCA Symposium on Security and Privacy in Speech Communication. 86--88.

[4]

Sourav Bhattacharya, Dionysis Manousakas, Alberto Gil CP Ramos, Stylianos I Venieris, Nicholas D Lane, and Cecilia Mascolo. 2020. Countering Acoustic Adversarial Attacks in Microphone-Equipped Smart Home Devices. ACM Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--24.

Digital Library

[5]

Jeremy A Blumenthal, Meera Adya, and Jacqueline Mogle. 2009. The Multiple Dimensions of Privacy: Testing Lay 'Expectations of Privacy'. University of Pennsylvania Journal of Constitutional Law 11, 2 (2009), 331.

[6]

Robert David, Jared Duke, Advait Jain, Vijay Janapa Reddi, Nat Jeffries, Jian Li, Nick Kreeger, Ian Nappier, Meghna Natraj, Tiezhen Wang, et al. 2021. TensorFlow Lite Micro: Embedded Machine Learning for TinyML Systems. Proceedings of Machine Learning and Systems 3 (2021), 800--811.

[7]

Jacob Donley, Christian Ritz, and W Bastiaan Kleijn. 2016. Improving Speech Privacy in Personal Sound Zones. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 311--315.

[8]

Edge Impulse. 2022. https://www.edgeimpulse.com/. [Accessed June-2022].

[9]

Leah Findlater, Steven Goodman, Yuhang Zhao, Shiri Azenkot, and Margot J. Hanley. 2020. Fairness issues in AI systems that augment sensory abilities. ACM SIGACCESS Accessibility and Computing 125 (2020), 8.

[10]

Shabnam Ghaffarzadegan, Attila Reiss, Mirko Ruhs, Robert Duerichen, and Zhe Feng. 2017. Occupancy Detection in Commercial and Residential Environments Using Audio Signal. In INTERSPEECH. 3802--3806.

[11]

Gee Yeun Kim, Seung-Su Shin, Jin Young Kim, and Hyoung-Gook Kim. 2018. Sound event detection and haptic vibration based home monitoring assistant system for the deaf and hard-of-hearing. In Proceedings of the 2018 Workshop on Multimedia for Accessible Human Computer Interface. 1--7.

Digital Library

[12]

Kazuhiro Kondo and Hiroki Sakurai. 2014. Gender-Dependent Babble Maskers Created From Multi-Speaker Speech for Speech Privacy Protection. In 10th International Conference on Intelligent Information Hiding and Multimedia Signal Processing. 251--254.

[13]

Dawei Liang, Wenting Song, and Edison Thomaz. 2020. Characterizing the Effect of Audio Degradation on Privacy Perception And Inference Performance in Audio-Based Human Activity Recognition. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--10.

[14]

Daniyal Liaqat, Salaar Liaqat, Jun Lin Chen, Tina Sedaghat, Moshe Gabel, Frank Rudzicz, and Eyal de Lara. 2021. Coughwatch: Real-World Cough Detection using Smartwatches. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 8333--8337.

[15]

Andreas Nautsch, Abelino Jiménez, Amos Treiber, Jascha Kolberg, Catherine Jasserand, and Els Kindt et al. 2019. Preserving privacy in speaker and speech characterisation. Computer Speech & Language 58 (2019), 441--480.

Digital Library

[16]

Adedayo O Olaosun and Olawale Ogundiran. 2013. Assistive Technology For Hearing and Speech Disorders. Assistive Technology 3, 17 (2013).

[17]

Open Neural Network Exchange (ONNX). 2022. https://onnx.ai/index.html. [Accessed June-2022].

[18]

Yi-Hao Peng, Ming-Wei Hsu, Paul Taele, Ting-Yu Lin, Po-En Lai, and Leon Hsu et al. 2018. SpeechBubbles: Enhancing Captioning Experiences for Deaf and Hard-of-Hearing People in Group Conversations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 293.

[19]

Halley Profita, Reem Albaghli, Leah Findlater, Paul Jaeger, and Shaun K Kane. 2016. The AT effect: how disability affects the perceived social acceptability of head-mounted display use. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4884--4895.

Digital Library

[20]

Sarvapali D Ramchurn, Sebastian Stein, and Nicholas R Jennings. 2021. Trustworthy Human-AI Partnerships. iScience 24, 8 (2021), 102891.

[21]

Ke Sun, Chen Chen, and Xinyu Zhang. 2020. "Alexa, stop spying on me!" Speech Privacy Protection Against Voice Assistants. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 298--311.

Digital Library

[22]

Naoya Takahashi, Shota Inoue, and Yuki Mitsufuji. 2021. Adversarial Attacks on Audio Source Separation. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 521--525.

[23]

João E da R Tavares, Tefferson D da R Guterres, and Jorge LV Barbosa. 2019. Apollo APA: Towards a model to care of people with hearing impairment in smart environments. In Proceedings of the 25th Brazillian Symposium on Multimedia and the Web. 281--288.

Digital Library

[24]

M Vimalkumar, Sujeet Kumar Sharma, Jang Bahadur Singh, and Yogesh K Dwivedi. 2021. 'Okay Google, what about my privacy?': User's Privacy Perceptions and Acceptance of Voice Bbased Digital Assistants. Computers in Human Behavior 120 (2021), 106763.

Digital Library

[25]

Paul Voigt and Axel Von dem Bussche. 2017. The EU general data protection regulation (GDPR). A Practical Guide, 1st Ed., Cham: Springer International Publishing 10, 3152676 (2017), 10--5555.

[26]

Xin Wang and Junichi Yamagishi. 2021. A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection. In Proc. Interspeech 2021. 4259--4263.

[27]

Jennifer Williams, Junichi Yamagishi, Paul-Gauthier Noé, Cassia Valentini-Botinhao, and Jean-François Bonastre. 2021. Revisiting Speech Content Privacy. In 1st ISCA Symposium of the Security & Privacy in Speech Communication. 42--46.

[28]

Efstathios Zavvos, Enrico H. Gerding, Vahid Yazdanpanah, Carsten Maple, Sebastian Stein, and m.c. schraefel. 2021. Privacy and Trust in the Internet of Vehicles. IEEE Transactions on Intelligent Transportation Systems (2021), 1--16.

Cited By

Williams JAzim TPiskopani AChamberlain AZhang S(2023)Socio-Technical Trust For Multi-Modal Hearing Assistive Technology2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)10.1109/ICASSPW59220.2023.10193586(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSPW59220.2023.10193586
Williams JYazdanpanah VStein S(2023)Privacy-Preserving Occupancy EstimationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10095340(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10095340

Index Terms

Safe audio AI services in smart buildings

Recommendations

BuildingSage: A safe and secure AI copilot for smart buildings
BuildSys '24: Proceedings of the 11th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

The dawn of Generative AI is promising to deliver various benefits across all walks of life, including the built environment sector. While there are many opportunities, sharing proprietary and sensitive data with large generative AI models is seen as a ...
Melody Transcription From Music Audio: Approaches and Evaluation

Although the process of analyzing an audio recording of a music performance is complex and difficult even for a human listener, there are limited forms of information that may be tractably extracted and yet still enable interesting applications. We ...
Generative Audio and Real-Time Soundtrack Synthesis in Gaming Environments: An exploration of how dynamically rendered soundtracks can introduce new artistic sound design opportunities and enhance the immersion of interactive audio spaces.
OzCHI '20: Proceedings of the 32nd Australian Conference on Human-Computer Interaction

An important yet oft-overlooked front in the scope of interactive media, audio technologies have remained relatively stagnant compared to groundbreaking advancements made in fields such as visual fidelity and virtual reality. This paper explores the use ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

BuildSys '22: Proceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

November 2022

535 pages

ISBN:9781450398909

DOI:10.1145/3563357

General Chair:
Jorge Ortiz
Rutgers University

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGEnergy: ACM Special Interest Group on Energy Systems and Informatics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 December 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Turing AI Acceleration Fellowship on Citizen-Centric AI Systems
UK Engineering and Physical Sciences Research Council (EPSRC) through the Trustworthy Autonomous Systems Hub

Conference

BuildSys '22

Sponsor:

SIGEnergy

BuildSys '22: The 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation

November 9 - 10, 2022

Massachusetts, Boston

Acceptance Rates

Overall Acceptance Rate 148 of 500 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
105
Total Downloads

Downloads (Last 12 months)31
Downloads (Last 6 weeks)3

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Williams JAzim TPiskopani AChamberlain AZhang S(2023)Socio-Technical Trust For Multi-Modal Hearing Assistive Technology2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)10.1109/ICASSPW59220.2023.10193586(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSPW59220.2023.10193586
Williams JYazdanpanah VStein S(2023)Privacy-Preserving Occupancy EstimationICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP49357.2023.10095340(1-5)Online publication date: 4-Jun-2023
https://doi.org/10.1109/ICASSP49357.2023.10095340

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents