More Web Proxy on the site http://driver.im/

research-article

Open access

Non-Acoustic Speech Sensing System Based on Flexible Piezoelectric

Authors:

Shangchun FanAuthors Info & Claims

SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems

Pages 1055 - 1060

https://doi.org/10.1145/3560905.3567768

Published: 24 January 2023 Publication History

Abstract

Speech is one of the most important biological signals to complement human-human and human-computer interaction. Traditional speech datasets were collected by air microphones, but using these datasets in noisy environments such as factories is practically challenging. Therefore, speech recognition in noisy environments poses higher requirements. The non-acoustic speech dataset plays a significant role in robust speech recognition under high background noise. Existing datasets suffered from dull sound, low intelligibility and poor recognition accuracy due to hardware and computer technology limitations. This paper presents a non-acoustic speech sensing system based on flexible piezoelectric. The system collected vibration signals from the jaws of six males and five females, and the corpus contained ten different control commands at 90 dB of background noise. The dataset is reliable with high intelligibility and capable of achieving 93.7% recognition accuracy by calculation. With the aforementioned benefits, this dataset is an essential tool for studying human-computer interaction in high-noise environments, analyzing human acoustic properties, and aiding medical rehabilitation.

References

[1]

Z. Wang, C. Hu, D. Zheng, X. Chen, Ultralow-power sensing framework for internet of things: A smart gas meter as a case, IEEE Internet of Things Journal 9 (10) (2022) 7533--7544.

[2]

X. Chen, C. Ruiz, S. Zeng, L. Gao, A. Purohit, S. Carpin, P. Zhang, H-drunkwalk: Collaborative and adaptive navigation for heterogeneous mav swarm, ACM Trans. Sen. Netw. 16 (2) (apr 2020).

Digital Library

[3]

X. Chen, S. Xu, J. Han, H. Fu, X. Pi, C. Joe-Wong, Y. Li, L. Zhang, H. Y. Noh, P. Zhang, Pas: Prediction-based actuation system for city-scale ridesharing vehicular mobile crowdsensing, IEEE Internet of Things Journal 7 (5) (2020) 3719--3734.

[4]

X. Chen, S. Xu, X. Liu, X. Xu, H. Y. Noh, L. Zhang, P. Zhang, Adaptive hybrid model-enabled sensing system (hmss) for mobile fine-grained air pollution estimation, IEEE Transactions on Mobile Computing 21 (6) (2022) 1927--1944.

[5]

S. Xu, X. Chen, X. Pi, C. Joe-Wong, P. Zhang, H. Y. Noh, ilocus: Incentivizing vehicle mobility to optimize sensing distribution in crowd sensing, IEEE Transactions on Mobile Computing 19 (8) (2019) 1831--1847.

[6]

P. Tran, T. Letowski, M. McBride, Bone conduction microphone: Head sensitivity mapping for speech intelligibility and sound quality, in: 2008 International Conference on Audio, Language and Image Processing, 2008, pp. 107--111.

[7]

T. Shimamura, T. Tamiya, A reconstruction filter for bone-conducted speech, in: 48th Midwest Symposium on Circuits and Systems, 2005., 2005, pp. 1847--1850 Vol. 2.

[8]

T. T. Vu, M. Unoki, M. Akagi, An lp-based blind model for restoring bone-conducted speech, EITI Technical Research Report 107 (551) (2008) 17--22.

[9]

K. Kondo, T. Fujita, K. Nakagawa, On equalization of bone conducted speech for improved speech quality, in: IEEE International Symposium on Signal Processing Information Technology, 2007, pp. 1--2.

[10]

X. Yibao, Z. Xiongwei, Z. Changyan, C. Tieyong, Bone guided speech library establishment and mutual information analysis of bone guided speech(chinese), Acoustics Technology 38 (3) (2019) 5.

[11]

M. Turan, E. Erzin, Domain adaptation for food intake classification with teacher/student learning, IEEE Transactions on Multimedia PP (99) (2020) 1--1.

[12]

D. D. Mehta, M. Zaartu, S. W. Feng, H. A. Cheyne Ii, R. E. Hillman, Mobile voice health monitoring using a wearable accelerometer sensor and a smartphone platform, IEEE transactions on bio-medical engineering 59 (11) (2012) 3090--6.

[13]

S. Zhang, K. K. Ang, D. Zheng, Q. Hui, X. Chen, Y. Li, N. Tang, E. Chew, R. Y. Lim, C. Guan, Learning eeg representations with weighted convolutional siamese network: a large multi-session post-stroke rehabilitation study, IEEE Transactions on Neural Systems and Rehabilitation Engineering (2022).

[14]

X. Liu, R. Shi, Q. Hui, S. Xu, S. Wang, R. Na, Y. Sun, W. Ding, D. Zheng, X. Chen, Tcacnet: Temporal and channel attention convolutional network for motor imagery classification of eeg-based bci, Information Processing & Management 59 (5) (2022) 103001.

Digital Library

[15]

Y. Sun, W. Ding, X. Liu, D. Zheng, X. Chen, Q. Hui, R. Na, S. Wang, S. Fan, Cross-subject fusion based on time-weighting canonical correlation analysis in ssvep-bcis, Measurement 199 (2022) 111524.

[16]

R. Na, C. Hu, Y. Sun, S. Wang, S. Zhang, M. Han, W. Yin, J. Zhang, X. Chen, D. Zheng, An embedded lightweight ssvep-bci electric wheelchair with hybrid stimulator, Digital Signal Processing 116 (2021) 103101.

Digital Library

[17]

C. Dagdeviren, Y. Su, P. Joe, R. Yona, Y. Liu, Y.-S. Kim, Y. Huang, A. R. Damadoran, J. Xia, L. W. Martin, et al., Conformable amplified lead zirconate titanate sensors with enhanced piezoelectric response for cutaneous pressure monitoring, Nature communications 5 (1) (2014) 1--10.

[18]

L. Qiu, M. Bulut Coskun, Y. Tang, J. Z. Liu, T. Alan, J. Ding, V.-T. Truong, D. Li, Ultrafast dynamic piezoresistive response of graphene-based cellular elastomers, Advanced Materials 28 (1) (2016) 194--200.

[19]

S. Gao, C. Zheng, Y. Zhao, Z. Wu, J. Li, X. Huang, Comparison of enhancement techniques based on neural networks for attenuated voice signal captured by flexible vibration sensors on throats, Nanotechnology and Precision Engineering 5 (1) (2022) 013001.

[20]

D. Kim, D. Kim, H. Lee, Y. R. Jeong, S.-J. Lee, G. Yang, H. Kim, G. Lee, S. Jeon, G. Zi, et al., Body-attachable and stretchable multisensors integrated with wirelessly rechargeable energy storage devices, Advanced Materials 28 (4) (2016) 748--756.

[21]

I.-T. Recommendation, Perceptual evaluation of speech quality (pesq): An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs, Rec. ITU-T P. 862 (2001).

[22]

C. H. Taal, R. C. Hendriks, R. Heusdens, J. Jensen, A short-time objective intelligibility measure for time-frequency weighted noisy speech, in: 2010 IEEE international conference on acoustics, speech and signal processing, IEEE, 2010, pp. 4214--4217.

[23]

C. H. Taal, R. C. Hendriks, R. Heusdens, J. Jensen, An algorithm for intelligibility prediction of time-frequency weighted noisy speech, IEEE Transactions on Audio, Speech, and Language Processing 19 (7) (2011) 2125--2136.

Digital Library

[24]

Y. Itoh, K. Tajima, N. Kuwabara, Measurement of subjective communication quality for optical mobile communication systems by using mean opinion score, in: 11th IEEE International Symposium on Personal Indoor and Mobile Radio Communications. PIMRC 2000. Proceedings (Cat. No.00TH8525), Vol. 2, 2000, pp. 1330--1334 vol.2.

Cited By

Liang SZhou YJiang ZLong ZXing LXue X(2024)Ultrasound-responsive and biodegradable BTO/PLLA piezoelectric films for wireless neurostimulationProceedings of the 2024 4th International Conference on Signal Processing and Communication Technology10.1145/3712464.3714332(329-334)Online publication date: 27-Dec-2024
https://dl.acm.org/doi/10.1145/3712464.3714332
Li JGe CTao JWang JXu XChen XGui WLiang XDing W(2023)SolareSkin: Self-powered Visible Light Sensing Through a Solar Cell E-SkinAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3612904(664-669)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594739.3612904
Yuan SGao QSun YZheng D(2023)Anti-High Decibel Keyword Spotting System Based on Flexible Sensor2023 IEEE 16th International Conference on Electronic Measurement & Instruments (ICEMI)10.1109/ICEMI59194.2023.10270594(170-175)Online publication date: 9-Aug-2023
https://doi.org/10.1109/ICEMI59194.2023.10270594

Index Terms

Non-Acoustic Speech Sensing System Based on Flexible Piezoelectric
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing

Recommendations

Acoustic properties of non-native clear speech: Korean speakers of English
Highlights
- Non-native clear speech is acoustically distinct from casual speech.
- The nature of modifications is the same in native and non-native clear speech.
- The magnitude of modifications is different in native and non-native clear speech. ...
Abstract
The present study examined the acoustic properties of clear speech produced by non-native speakers of English (L1 Korean), in comparison to native clear speech. L1 Korean speakers of English (N=30) and native speakers of English (N=20) read an ...
MFCC-GMM based accent recognition system for Telugu speech signals

Speech processing is very important research area where speaker recognition, speech synthesis, speech codec, speech noise reduction are some of the research areas. Many of the languages have different speaking styles called accents or dialects. ...
Acoustic model adaptation based on pronunciation variability analysis for non-native speech recognition

In this paper, pronunciation variability between native and non-native speakers is investigated, and a novel acoustic model adaptation method is proposed based on pronunciation variability analysis in order to improve the performance of a speech ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems

November 2022

1280 pages

ISBN:9781450398862

DOI:10.1145/3560905

General Chairs:
Jeremy Gummeson
University of Massachusetts Amherst
,
Sunghoon Ivan Lee
University of Massachusetts Amherst
,
Program Chairs:
Jie Gao
Rutgers University
,
Guoliang Xing
The Chinese University of Hong Kong

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2023

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
Universities-Youth Talent Support Program of Beihang University
Key Laboratory of Precision Opto-mechatronics Technology, Ministry of Education (Beihang University)
Institute for Web and Digital Media Research (Beihang University)

Conference

SenSys '22

Sponsor:

SenSys '22: The 20th ACM Conference on Embedded Networked Sensor Systems

November 6 - 9, 2022

Massachusetts, Boston

Acceptance Rates

SenSys '22 Paper Acceptance Rate 52 of 187 submissions, 28%;

Overall Acceptance Rate 198 of 990 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
309
Total Downloads

Downloads (Last 12 months)159
Downloads (Last 6 weeks)27

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liang SZhou YJiang ZLong ZXing LXue X(2024)Ultrasound-responsive and biodegradable BTO/PLLA piezoelectric films for wireless neurostimulationProceedings of the 2024 4th International Conference on Signal Processing and Communication Technology10.1145/3712464.3714332(329-334)Online publication date: 27-Dec-2024
https://dl.acm.org/doi/10.1145/3712464.3714332
Li JGe CTao JWang JXu XChen XGui WLiang XDing W(2023)SolareSkin: Self-powered Visible Light Sensing Through a Solar Cell E-SkinAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3612904(664-669)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594739.3612904
Yuan SGao QSun YZheng D(2023)Anti-High Decibel Keyword Spotting System Based on Flexible Sensor2023 IEEE 16th International Conference on Electronic Measurement & Instruments (ICEMI)10.1109/ICEMI59194.2023.10270594(170-175)Online publication date: 9-Aug-2023
https://doi.org/10.1109/ICEMI59194.2023.10270594

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten