[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Dynamic sensor activation and decision-level fusion in wireless acoustic sensor networks for classification of domestic activities

Published: 01 January 2022 Publication History

Abstract

For the past decades there has been a rising interest for wireless sensor networks to obtain information about an environment. One interesting modality is that of audio, as it is highly informative for numerous applications including speech recognition, urban scene classification, city monitoring, machine listening and classifying domestic activities. However, as they operate at prohibitively high energy consumption, commercialisation of battery-powered wireless acoustic sensor networks has been limited. To increase the network’s lifetime, this paper explores the joint use of decision-level fusion and dynamic sensor activation. Hereby adopting a topology where processing – including feature extraction and classification – is performed on a dynamic set of sensor nodes that communicate classification outputs which are fused centrally. The main contribution of this paper is the comparison of decision-level fusion with different dynamic sensor activation strategies on the use case of automatically classifying domestic activities. Results indicate that using vector quantisation to encode the classification output, computed at each sensor node, can reduce the communication per classification output to 8 bit without loss of significant performance. As the cost for communication is reduced, local processing tends to dominate the overall energy budget. It is indicated that dynamic sensor activation, using a centralised approach, can reduce the average time a sensor node is active up to 20% by leveraging redundant information in the network. In terms of energy consumption, this resulted in an energy reduction of up to 80% as the cost for computation dominates the overall energy budget.

Highlights

Edge computing is favoured when automatically classifying audio in a Wireless Acoustic Sensor Network to reduce a sensor node’s energy consumption.
Combining the classification outputs of sensor nodes by means of decision-level fusion is beneficial in terms of classification performance compared to a single sensor node.
Vector quantisation on the classification outputs of each sensor node reduces the total communication bandwidth up to 8 bit per classification output with negligble loss in performance.
Dynamically (de-)activating sensor nodes, using a centralised approach, reduces the average duty cycle up to 80%.

References

[1]
Borkar S., Chien A.A., The future of microprocessors, Commun. ACM 54 (5) (2011) 67–77,.
[2]
M. Vacher, D. Istrate, F. Portet, T. Joubert, T. Chevalier, S. Smidtas, B. Meillon, B. Lecouteux, M. Sehili, P. Chahuara, S. Méniard, The sweet-home project: Audio technology in smart homes to improve well-being and reliance, in: 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2011, pp. 5291–5294.
[3]
Stowell D., Giannoulis D., Benetos E., Lagrange M., Plumbley M.D., Detection and classification of acoustic scenes and events, IEEE Trans. Multimed. 17 (10) (2015) 1733–1746.
[4]
Mesaros A., Heittola T., Benetos E., Foster P., Lagrange M., Virtanen T., Plumbley M.D., Detection and classification of acoustic scenes and events: Outcome of the DCASE 2016 challenge, IEEE/ACM Trans. Audio, Speech and Lang. Proc. 26 (2) (2018) 379–393.
[5]
A. Mesaros, T. Heittola, A. Diment, B. Elizalde, A. Shah, E. Vincent, B. Raj, T. Virtanen, DCASE 2017 Challenge setup: Tasks, datasets and baseline system, in: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop, DCASE2017, Munich, Germany, 2017.
[6]
G. Dekkers, S. Lauwereins, B. Thoen, M.W. Adhana, H. Brouckxon, T. van Waterschoot, B. Vanrumste, M. Verhelst, P. Karsmakers, The SINS database for detection of daily activities in a home environment using an acoustic sensor network, in: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2017 Workshop, DCASE2017, Munich, Germany, 2017, pp. 32–36.
[7]
A. Bertrand, Applications and trends in wireless acoustic sensor networks: A signal processing perspective, in: 2011 18th IEEE Symposium on Communications and Vehicular Technology in the Benelux, SCVT, 2011, pp. 1–6.
[8]
Lauwereins S., Cross-layer Self-Adaptivity for Ultra-Low Power Responsive IoT Devices, (Ph.D. thesis) KU Leuven, 2018.
[9]
Dekkers G., Rosas F., Lauwereins S., Rajendran S., Pollin S., Vanrumste B., van Waterschoot T., Verhelst M., Karsmakers P., A Multi-Layered Energy Consumption Model for Smart Wireless Acoustic Sensor Networks, KU Leuven, 2018, arXiv:1812.06672.
[10]
Rosas F., Souza R.D., Pellenz M.E., Oberli C., Brante G., Verhelst M., Pollin S., Optimizing the code rate of energy-constrained wireless communications with HARQ, IEEE Trans. Wireless Commun. 15 (1) (2016) 191–205.
[11]
Cychosz M., Romeo R., Soderstrom M., Scaff C., Ganek H., Cristia A., Casillas M., de Barbaro K., Bang J., Weisleder A., Longform recordings of everyday life: Ethics for best practices, Behav. Res. Methods (2020).
[12]
Carrano R.C., Passos D., Magalhaes L.C.S., Albuquerque C.V.N., Survey and taxonomy of duty cycling mechanisms in wireless sensor networks, IEEE Commun. Surv. Tutor. 16 (1) (2014) 181–194.
[13]
Engmann F., Katsriku F., Abdulai J.-D., Adu-Manu K., Reducing the energy budget in WSN using time series models, Wirel. Commun. Mob. Comput. 2020 (2020) 1–15.
[14]
Debes C., Merentitis A., Sukhanov S., Niessen M., Frangiadakis N., Bauer A., Monitoring activities of daily living in smart homes: Understanding human behavior, IEEE Signal Process. Mag. 33 (2) (2016) 81–94.
[15]
Erden F., Velipasalar S., Alkar A.Z., Cetin A.E., Sensors in Assisted Living: A survey of signal and image processing methods, IEEE Signal Process. Mag. 33 (2) (2016) 36–44,.
[16]
Butun I., Morgera S.D., Sankar R., A survey of intrusion detection systems in wireless sensor networks, IEEE Commun. Surv. Tutor. 16 (1) (2014) 266–282.
[17]
B. Thoen, G. Ottoy, F. Rosas, S. Lauwereins, S. Rajendran, L. De Strycker, S. Pollin, M. Verhelst, Saving energy in WSNs for acoustic surveillance applications while maintaining QoS, in: 2017 IEEE Sensors Applications Symposium, SAS, 2017, pp. 1–6.
[18]
Barchiesi D., Giannoulis D., Stowell D., Plumbley M.D., Acoustic scene classification: Classifying environments from the sounds they produce, IEEE Signal Process. Mag. 32 (3) (2015) 16–34.
[19]
E. Fonseca, M. Plakal, F. Font, D.P.W. Ellis, X. Favory, J. Pons, X. Serra, General-purpose tagging of freesound audio with AudioSet labels: Task description, dataset, and baseline, in: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop, DCASE2018, Surrey, UK, 2018.
[20]
D. Stowell, Y. Stylianou, M. Wood, H. Pamuła, H. Glotin, Automatic acoustic detection of birds through deep learning: the first Bird Audio Detection challenge, in: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop, DCASE2018, Surrey, UK, 2018.
[21]
R. Serizel, N. Turpault, H. Eghbal-Zadeh, A. Parag Shah, Large-scale weakly labeled semi-supervised sound event detection in domestic environments, in: Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop, DCASE2018, Surrey, UK, 2018.
[22]
Virtanen T., Plumbley M., Ellis D., Computational analysis of sound scenes and events, 2017, pp. 1–422.
[23]
Liu J., Sohn J., Kim S., Classification of daily activities for the elderly using wearable sensors, J. Healthc. Eng. 2017 (2017) 1–7.
[24]
Hussain R.G., Ghazanfar M.A., Azam M.A., Naeem U., Ur Rehman S., A performance comparison of machine learning classification approaches for robust activity of daily living recognition, Artif. Intell. Rev. (2018).
[25]
Fleury A., Vacher M., Noury N., SVM-based multi-modal classification of activities of daily living in health smart homes: Sensors, algorithms and first experimental results, IEEE Trans. Inf. Technol. Biomed. 14 (2010) 274–283.
[26]
Fortino G., Guzzo A., Ianni M., Leotta F., Mecella M., Exploiting marked temporal point processes for predicting activities of daily living, 2020, pp. 1–6.
[27]
M. Vacher, B. Lecouteux, P. Chahuara, F. Portet, B. Meillon, N. Bonnefond, The Sweet-Home speech and multimodal corpus for home automation interaction, in: The 9th Edition of the Language Resources and Evaluation Conference, LREC, Reykjavik, Iceland, 2014, pp. 4499–4506.
[28]
L. Vuegen, B. Van Den Broeck, P. Karsmakers, H. Van hamme, B. Vanrumste, Energy efficient monitoring of activities of daily living using wireless acoustic sensor networks in clean and noisy conditions, in: 2015 23rd European Signal Processing Conference, EUSIPCO, 2015, pp. 449–453.
[29]
Dekkers G., Vuegen L., van Waterschoot T., Vanrumste B., Karsmakers P., DCASE 2018 Challenge - Task 5: Monitoring of Domestic Activities Based on Multi-Channel Acoustics, KU Leuven, 2018, arXiv:1807.11246.
[30]
Khaleghi B., Khamis A., Karray F.O., Razavi S.N., Multisensor data fusion: A review of the state-of-the-art, Inf. Fusion 14 (1) (2013) 28–44.
[31]
Gosa Mangai U., Samanta S., Das S., Roy Chowdhury P., A survey of decision fusion and feature fusion strategies for pattern classification, IETE Tech. Rev. 27 (2010).
[32]
King R.C., Villeneuve E., White R.J., Sherratt R.S., Holderbaum W., Harwin W.S., Application of data fusion techniques and technologies for wearable health monitoring, Med. Eng. Phys. 42 (2017) 1–12.
[33]
Gravina R., Alinia P., Ghasemzadeh H., Fortino G., Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges, Inf. Fusion 35 (2017) 68–80.
[34]
J.N. Tsitsiklis, M. Athans, On the complexity of decentralized decision making and detection problems, in: The 23rd IEEE Conference on Decision and Control, 1984, pp. 1638–1641.
[35]
Rosas F., Chen K.C., Gündüz D., Social learning for resilient data fusion against data falsification attacks, Comput. Soc. Netw. 5 (2018) (2018).
[36]
I. Kuncheva L., Bezdek J., Duin R., Decision templates for multiple classifier fusion: An experimental comparison, Pattern Recognit. 34 (2001) 299–314.
[37]
Kittler J., Hatef M., Duin R.P.W., Matas J., On combining classifiers, IEEE Trans. Pattern Anal. Mach. Intell. 20 (3) (1998) 226–239.
[38]
Tsitsiklis J., Decentralized detection, in: Advances in Statistical Signal Processing, Vol. 2, 1993, pp. 297–344.
[39]
L. Vuegen, B. Van Den Broeck, P. Karsmakers, H. Van hamme, B. Vanrumste, Monitoring activities of daily living using Wireless Acoustic Sensor Networks in clean and noisy conditions, in: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC, 2015, pp. 4966–4969.
[40]
Grzeszick R., Plinge A., Fink G.A., Bag-of-features methods for acoustic event detection and classification, IEEE/ACM Trans. Audio Speech Lang. Process. 25 (6) (2017) 1242–1252.
[41]
I. Martín-Morató, M. Cobos, F.J. Ferri, Analysis of data fusion techniques for multi-microphone audio event detection in adverse environments, in: 2017 IEEE 19th International Workshop on Multimedia Signal Processing, MMSP, 2017, pp. 1–6.
[42]
Karl H., Willig A., Protocols and Architectures for Wireless Sensor Networks, John Wiley & Sons, 2007.
[43]
Sze V., Chen Y., Yang T., Emer J.S., Efficient processing of deep neural networks: A tutorial and survey, Proc. IEEE 105 (12) (2017) 2295–2329,.
[44]
Badami K.M.H., Lauwereins S., Meert W., Verhelst M., A 90 nm CMOS, 6μw power-proportional acoustic sensing frontend for voice activity detection, IEEE J. Solid-State Circuits 51 (1) (2016) 291–302.
[45]
Sigtia S., Stark A.M., Krstulović S., Plumbley M.D., Automatic environmental sound recognition: Performance versus computational cost, IEEE/ACM Trans. Audio Speech Lang. Process. 24 (11) (2016) 2096–2107.
[46]
Shih E., Cho S.-H., Ickes N., Min R., Sinha A., Wang A., Chandrakasan A., Physical layer driven protocol and algorithm design for energy-efficient wireless sensor networks, in: Proceedings of the 7th Annual International Conference on Mobile Computing and Networking, ACM, 2001, pp. 272–287.
[47]
Feng D., Jiang C., Lim G., Cimini L.J., Feng G., Li G.Y., A survey of energy-efficient wireless communications, IEEE Commun. Surv. Tutor. 15 (1) (2013) 167–178.
[48]
Cui S., Goldsmith A.J., Bahai A., Energy-constrained modulation optimization, IEEE Trans. Wireless Commun. 4 (5) (2005) 2349–2360.
[49]
F. Rosas, C. Oberli, Energy-efficient MIMO SVD communications, in: 2012 IEEE 23rd International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, 2012, pp. 1588–1593.
[50]
Ganesan D., Govindan R., Shenker S., Estrin D., Highly-resilient, energy-efficient multipath routing in wireless sensor networks, ACM SIGMOBILE Mob. Comput. Commun. Rev. 5 (4) (2001) 11–25.
[51]
Rosas F., Souza R.D., Verhelst M., Pollin S., Energy-efficient MIMO multihop communications using the antenna selection scheme, in: Wireless Communication Systems (ISWCS), 2015 International Symposium on, IEEE, 2015, pp. 686–690.
[52]
C. Schurgers, M.B. Srivastava, Energy efficient routing in wireless sensor networks, in: 2001 MILCOM Proceedings Communications for Network-Centric Operations: Creating the Information Force, Cat. No. 01CH37277, Vol. 1, 2001, pp. 357–361.
[53]
Ye W., Heidemann J., Estrin D., An energy-efficient MAC protocol for wireless sensor networks, in: Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE, Vol. 3, INFOCOM 2002, IEEE, 2002, pp. 1567–1576.
[54]
Yetgin H., Cheung K.T.K., El-Hajjar M., Hanzo L.H., A survey of network lifetime maximization techniques in wireless sensor networks, IEEE Commun. Surv. Tutor. 19 (2) (2017) 828–854.
[55]
Dekkers G., Rosas F., WASN EM: A Multi-Layered Energy Model for Wireless Acoustic Sensor Networks, GitHub, 2018, URL https://github.com/gertdekkers/WASN_EM/.
[56]
Cortex-M4: Technical Reference Manual, b ed., ARM Limited, 2010.
[57]
Specifications for Local and Metropolitan Area Networks- Specific Requirements Part 15.4, IEEE, 2006.
[58]
Dekkers G., Dynamic Sensor Activation and Decision-Level Fusion in Wireless Acoustic Sensor Networks for Classification of Domestic Activities: Figure 2, GitHub, 2019, URL https://github.com/KULeuvenADVISE/DynSensActPaper/.
[59]
Lloyd S.P., Least squares quantization in PCM, IEEE Trans. Inform. Theory 28 (1982) 129–137.
[60]
Jiang H., Confidence measures for speech recognition: A survey, Speech Commun. 45 (4) (2005) 455–470.
[61]
S. Wan, T. Wu, W.H. Wong, C. Lee, Confnet: Predict with confidence, in: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2018, Calgary, AB, Canada, April 15–20, 2018, 2018, pp. 2921–2925.
[62]
P. Giannoulis, G. Potamianos, A. Katsamanis, P. Maragos, Multi-microphone fusion for detection of speech and acoustic events in smart spaces, in: European Signal Processing Conference, 2014, pp. 2375–2379.

Cited By

View all
  • (2024)Acoustic scene classification using inter- and intra-subarray spatial features in distributed microphone arrayEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-024-00386-y2024:1Online publication date: 21-Dec-2024
  • (2024)Revolutionizing healthcareInformation Fusion10.1016/j.inffus.2024.102518111:COnline publication date: 1-Nov-2024

Index Terms

  1. Dynamic sensor activation and decision-level fusion in wireless acoustic sensor networks for classification of domestic activities
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Information Fusion
          Information Fusion  Volume 77, Issue C
          Jan 2022
          297 pages

          Publisher

          Elsevier Science Publishers B. V.

          Netherlands

          Publication History

          Published: 01 January 2022

          Author Tags

          1. Sound classification
          2. Activities of the Daily Living
          3. Wireless acoustic sensor network
          4. Edge computing
          5. Decision-level fusion
          6. Dynamic sensor activation

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 03 Mar 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Acoustic scene classification using inter- and intra-subarray spatial features in distributed microphone arrayEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-024-00386-y2024:1Online publication date: 21-Dec-2024
          • (2024)Revolutionizing healthcareInformation Fusion10.1016/j.inffus.2024.102518111:COnline publication date: 1-Nov-2024

          View Options

          View options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media