short-paper

Demo Abstract: In-Ear-Voice - Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms

Authors:

Michele MagnoAuthors Info & Claims

IoTDI '23: Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation

Pages 488 - 490

https://doi.org/10.1145/3576842.3589166

Published: 09 May 2023 Publication History

Get Access

Abstract

This demonstration presents a custom-developed research platform for low-power wireless earbuds based on the cutting-edge Ambiq Apollo 4 Blue SoC, and targeted at applications in in-ear sensing and on-the-edge data processing. The earbud shown is currently equipped with a novel, commercial MEMS bone-conduction microphone. Such microphones can record the wearer’s speech with much greater isolation, enabling personalized voice activity detection and further audio enhancement applications. The device is running a specialized, TinyML-based, voice activity detection algorithm, indicating the wearer’s speech using an onboard LED. A second identical earbud attempts to do the same detection using a traditional air-conduction microphone is also shown to underline the advantage the bone-conduction microphone provides. Overall the platform achieves 2.64mW average power consumption at 14uJ per inference, reaching 43h of battery life on a miniature 32mAh li-ion cell without duty cycling.

References

[1]

Sebastian Braun and Ivan Tashev. 2021. On training targets for noise-robust voice activity detection. (2021). https://doi.org/10.48550/ARXIV.2102.07445

Crossref

Google Scholar

[2]

Alicia Klinefelter, Huichu Liu, Luca Benini, Yvain Thonnart, Keith Bowman, Kathy Wilcox, David Bol, Alvin Loke, and Ofer Shacham. 2021. SE2: Going Remote: Challenges and Opportunities to Remote Learning, Work, and Collaboration. In 2021 IEEE International Solid- State Circuits Conference (ISSCC), Vol. 64. 539–540. https://doi.org/10.1109/ISSCC42613.2021.9365845

Crossref

Google Scholar

[3]

Tommaso Polonelli, Andrea Bentivogli, Guido Comai, and Michele Magno. 2022. Self-sustainable IoT Wireless Sensor Node for Predictive Maintenance on Electric Motors. In 2022 IEEE Sensors Applications Symposium (SAS). 1–6. https://doi.org/10.1109/SAS54819.2022.9881349

Digital Library

Google Scholar

[4]

Partha Pratim Ray. 2022. A review on TinyML: State-of-the-art and prospects. Journal of King Saud University - Computer and Information Sciences 34, 4 (2022), 1595–1623. https://doi.org/10.1016/j.jksuci.2021.11.019

Digital Library

Google Scholar

[5]

Philipp Schilk, Niccolò Polvani, Andrea Ronco, Milos Cernak, and Michele Magno. 2023. In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms. In International Conference on Internet-of-Things Design and Implementation (IoTDI ’23), May 9–12, 2023, San Antonio, TX, USA. 19. https://doi.org/10.1145/3576842.3582365

Digital Library

Google Scholar

[6]

Janto Skowronek, Alexander Raake, Gunilla H. Berndtsson, Olli S. Rummukainen, Paolino Usai, Simon N. B. Gunkel, Mathias Johanson, Emanuël A. P. Habets, Ludovic Malfait, David Lindero, and Alexander Toet. 2022. Quality of Experience in Telemeetings and Videoconferencing: A Comprehensive Survey. IEEE Access 10 (2022), 63885–63931. https://doi.org/10.1109/ACCESS.2022.3176369

Crossref

Google Scholar

Cited By

View all

Ronco ASchilk PMagno M(2024)TinyssimoRadar: In-Ear Hand Gesture Recognition with Ultra-Low Power mmWave Radars2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00021(192-202)Online publication date: 13-May-2024
https://doi.org/10.1109/IoTDI61053.2024.00021
Dheman KGiordano MThomas CSchilk PMagno M(2024)i-CardiAx: Wearable IoT-Driven System for Early Sepsis Detection Through Long-Term Vital Sign Monitoring2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00013(97-109)Online publication date: 13-May-2024
https://doi.org/10.1109/IoTDI61053.2024.00013

Index Terms

Demo Abstract: In-Ear-Voice - Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms
1. Computer systems organization
  1. Architectures
    1. Other architectures
      1. Neural networks
  2. Embedded and cyber-physical systems
    1. Sensors and actuators
2. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices
      1. Mobile devices

Recommendations

In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms
IoTDI '23: Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation

The recent ubiquitous adoption of remote conferencing has been accompanied by omnipresent frustration with distorted or otherwise unclear voice communication. Audio enhancement can compensate for low-quality input signals from, for example, small true ...
OpenEarable 1.4: Dual Microphones Earpiece to Capture In-Ear and Outer-Ear Audio Signals
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing

In recent years, earables have emerged as a focal point for exploring novel sensing principles on the ears. OpenEarable, an open reference platform, has been developed to integrate various sensors in and around the ears. However, it has thus far lacked ...
Database of multichannel in-ear and behind-the-ear head-related and binaural room impulse responses
Special issue on digital signal processing for hearing instruments

An eight-channel database of head-related impulse responses (HRIRs) and binaural room impulse responses (BRIRs) is introduced. The impulse responses (IRs) were measured with three-channel behind-the-ear (BTEs) hearing aids and an in-ear microphone at ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IoTDI '23: Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation

May 2023

514 pages

ISBN:9798400700378

DOI:10.1145/3576842

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 May 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

IoTDI '23

Sponsor:

SIGBED

IoTDI '23: International Conference on Internet-of-Things Design and Implementation

May 9 - 12, 2023

TX, San Antonio, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
65
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)2

Reflects downloads up to 19 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ronco ASchilk PMagno M(2024)TinyssimoRadar: In-Ear Hand Gesture Recognition with Ultra-Low Power mmWave Radars2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00021(192-202)Online publication date: 13-May-2024
https://doi.org/10.1109/IoTDI61053.2024.00021
Dheman KGiordano MThomas CSchilk PMagno M(2024)i-CardiAx: Wearable IoT-Driven System for Early Sepsis Detection Through Long-Term Vital Sign Monitoring2024 IEEE/ACM Ninth International Conference on Internet-of-Things Design and Implementation (IoTDI)10.1109/IoTDI61053.2024.00013(97-109)Online publication date: 13-May-2024
https://doi.org/10.1109/IoTDI61053.2024.00013

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms

OpenEarable 1.4: Dual Microphones Earpiece to Capture In-Ear and Outer-Ear Audio Signals

Database of multichannel in-ear and behind-the-ear head-related and binaural room impulse responses

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations