[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

Extracting Multi-Person Respiration from Entangled RF Signals

Published: 05 July 2018 Publication History

Abstract

Recent advances in wireless systems have demonstrated the possibility of tracking a person's respiration using the RF signals that bounce off her body. The resulting breathing signal can be used to infer the person's sleep quality and stages; it also allows for monitoring sleep apnea and other sleep disordered breathing (SDB); all without any body contact. Unfortunately however past work fails when people are close to each other, e.g., a couple sharing the same bed. In this case, the breathing signals of nearby individuals interfere with each other and super-impose in the received signal.
This paper presents DeepBreath, the first RF-based respiration monitoring system that can recover the breathing signals of multiple individuals even when they are separated by zero distance. To design DeepBreath, we model interference due to multiple reflected RF signals and demonstrate that the original breathing can be recovered via independent component analysis (ICA). We design a full system that eliminates interference and recovers the original breathing signals. We empirically evaluate DeepBreath using 21 nights of sleep and over 150 hours of data from 13 couples who share the bed. Our results show that DeepBreath is very accurate. Specifically, the differences between the breathing signals it recovers and the ground truth are on par with the difference between the same breathing signal measured at the person's chest and belly.

Supplementary Material

yue (yue.zip)
Supplemental movie, appendix, image and software files for, Extracting Multi-Person Respiration from Entangled RF Signals

References

[1]
Fadel Adib, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections. In NSDI.
[2]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In CHI.
[3]
Laiali Almazaydeh, Khaled Elleithy, Miad Faezipour, and Ahmad Abushakra. 2013. Apnea detection based on respiratory signal classification. Procedia Computer Science (2013).
[4]
Richard B Berry, Rohit Budhiraja, Daniel J Gottlieb, David Gozal, Conrad Iber, Vishesh K Kapur, Carole L Marcus, Reena Mehra, and others. 2012. Rules for scoring respiratory events in sleep: update of the 2007 AASM manual for the scoring of sleep and associated events: deliberations of the sleep apnea definitions task force of the American Academy of Sleep Medicine. JCSM (2012).
[5]
Bosch 2018. https://www.boschtools.com/us/en/boschtools-ocs/laser-measuring-glm-50-35087-p/. (2018).
[6]
Mary A Carskadon, William C Dement, and others. 2005. Normal human sleep: an overview. Principles and practice of sleep medicine (2005).
[7]
Ashish Chaddha. 2015. Slow breathing and cardiovascular disease. International journal of yoga (2015).
[8]
Seungjin Choi, Andrzej Cichocki, Hyung-Min Park, and Soo-Young Lee. 2005. Blind source separation and independent component analysis: A review. Neural Information Processing-Letters and Reviews (2005).
[9]
Sergei Churkin and Lesya Anishchenko. 2015. Millimeter-wave radar for vital signs monitoring. In COMCAS. IEEE.
[10]
Luciane de Souza, Ana Amélia Benedito-Silva, Maria Laura Nogueira Pires, Dalva Poyares, Sergio Tufik, and Helena Maria Calil. 2003. Further validation of actigraphy for sleep studies. Sleep (2003).
[11]
Arnaud Delorme and Scott Makeig. 2004. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. Journal of neuroscience methods (2004).
[12]
WW Flemons, D Buysse, S Redline, A Oack, K Strohl, J Wheatley, T Young, N Douglas, P Levy, W McNicolas, and others. 1999. Sleep-related breathing disorders in adults: recommendations for syndrome definition and measurement techniques in clinical research. Sleep (1999).
[13]
William F Ganong and William Ganong. 1995. Review of medical physiology. Appleton 8 Lange Norwalk, CT.
[14]
Chen-Yu Hsu, Aayush Ahuja, Shichao Yue, Rumen Hristov, Zachary Kabelac, and Dina Katabi. 2017. Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals. IMWUT (2017).
[15]
Chen-Yu Hsu, Yuchen Liu, Zachary Kabelac, Rumen Hristov, Dina Katabi, and Christine Liu. 2017. Extracting Gait Velocity and Stride Length from Surrounding Radio Signals. In CHI. ACM.
[16]
Aapo Hyvärinen, Juha Karhunen, and Erkki Oja. 2004. Independent component analysis. John Wiley 8 Sons.
[17]
Aapo Hyvärinen and Erkki Oja. 2000. Independent component analysis: algorithms and applications. Neural networks (2000).
[18]
Swarun Kumar, Stephanie Gil, Dina Katabi, and Daniela Rus. 2014. Accurate indoor localization with zero start-up cost. In MobiCom. ACM.
[19]
Mark E Kunik, Kent Roundy, Connie Veazey, Julianne Souchek, Peter Richardson, Nelda P Wray, and Melinda A Stanley. 2005. Surprisingly high prevalence of anxiety and depression in chronic breathing disorders. Chest (2005).
[20]
Ronald Ley. 1994. Breathing and the psychology of emotion, cognition, and behavior. In Behavioral and psychological approaches to breathing disorders.
[21]
Xuefeng Liu, Jiannong Cao, Shaojie Tang, and Jiaqi Wen. 2014. Wi-Sleep: Contactless sleep monitoring via WiFi signals. In RTSS. IEEE.
[22]
Xi Long, Jie Yang, Tim Weysen, Reinder Haakma, Jérôme Foussier, Pedro Fonseca, and Ronald M Aarts. 2014. Measuring dissimilarity between respiratory effort signals based on uniform scaling for sleep staging. Physiological measurement (2014).
[23]
Bassem R Mahafza. 2002. Radar systems analysis and design using MATLAB. CBC Press.
[24]
Nikolaos Mitianoudis and Tania Stathaki. 2007. Pixel-based and region-based image fusion schemes using ICA bases. Information Fusion (2007).
[25]
Ken Monahan, Amy Storfer-Isser, Reena Mehra, Eyal Shahar, Murray Mittleman, Jeff Rottman, Naresh Punjabi, Mark Sanders, Stuart F Quan, Helaine Resnick, and others. 2009. Triggering of nocturnal arrhythmias by sleep-disordered breathing events. Journal of the American College of Cardiology (2009).
[26]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In MobiSys. ACM.
[27]
F Javier Nieto, Terry B Young, Bonnie K Lind, Eyal Shahar, Jonathan M Samet, Susan Redline, Ralph B D'agostino, Anne B Newman, Michael D Lebowitz, Thomas G Pickering, and others. 2000. Association of sleep-disordered breathing, sleep apnea, and hypertension in a large community-based study. Jama (2000).
[28]
Erkki Oja. 2004. Applications of independent component analysis. In International Conference on Neural Information Processing. Springer.
[29]
Kurt Peek. 2011. Estimation and compensation of frequency sweep nonlinearity in FMCW radar. Master's thesis. University of Twente.
[30]
Pulmonology 2018. https://www.columbiamemorialhealth.org/pulmonology/. (2018).
[31]
Tauhidur Rahman, Alexander T Adams, Ruth Vinisha Ravichandran, Mi Zhang, Shwetak N Patel, Julie A Kientz, and Tanzeem Choudhury. 2015. Dopplesleep: A contactless unobtrusive sleep sensing system using short-range doppler radar. In UbiComp. ACM.
[32]
Alejandro Rodríguez-Molinero, Leire Narvaiza, Jorge Ruiz, and César Gálvez-Barrón. 2013. Normal respiratory rate and peripheral blood oxygen saturation in the elderly population. Journal of the American Geriatrics Society (2013).
[33]
Hiroshi Saruwatari, Satoshi Kurita, and Kazuya Takeda. 2001. Blind source separation combining frequency-domain ICA and beamforming. In ICASSP. IEEE.
[34]
Nandakumar Selvaraj. 2015. Psychological acute stress measurement using a wireless adhesive biosensor. In EMBC. IEEE.
[35]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint (2014).
[36]
Sleepview 2018. https://clevemed.com/sleepview/. (2018).
[37]
Frederick Snyder, J Allan Hobson, Donald F Morrison, and Frederick Goldfrank. 1964. Changes in respiration, heart rate, and systolic blood pressure in human sleep. Journal of Applied Physiology (1964).
[38]
Tania Stathaki. 2011. Image fusion: algorithms and applications. Elsevier.
[39]
Yu Takahashi, Tomoya Takatani, Keiichi Osako, Hiroshi Saruwatari, and Kiyohiro Shikano. 2009. Blind spatial subtraction array for speech enhancement in noisy environment. IEEE transactions on audio, speech, and language processing (2009).
[40]
Alexander Tataraidze, Lesya Anishchenko, Lyudmila Korostovtseva, Bert Jan Kooij, Mikhail Bochkarev, and Yurii Sviryaev. 2015. Sleep stage classification based on respiratory signal. In EMBC. IEEE.
[41]
Wang Tianben, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2017. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. In IMWUT.
[42]
Péter Várady, Szabolcs Bongár, and Zoltán Benyó. 2003. Detection of airway obstructions and sleep apnea by analyzing the phase relation of respiration movement signals. IEEE Transactions on Instrumentation and Measurement (2003).
[43]
Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In UbiComp. ACM.
[44]
Yang Xu, Wei Yang, Jianxin Wang, Xing Zhou, Hong Li, and Liusheng Huang. 2018. WiStep: Device-free Step Counting with WiFi Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (2018).
[45]
Zhicheng Yang, Parth H Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2016. Monitoring vital signs using millimeter wave. In Mobihoc. ACM.
[46]
Terry Young, Laurel Finn, Paul E Peppard, Mariana Szklo-Coxe, Diane Austin, F Javier Nieto, Robin Stubbs, and K Mae Hla. 2008. Sleep disordered breathing and mortality: eighteen-year follow-up of the Wisconsin sleep cohort. Sleep (2008).
[47]
Terry Young, Paul Peppard, Mari Palta, K Mae Hla, Laurel Finn, Barbara Morgan, and James Skatrud. 1997. Population-based study of sleep-disordered breathing as a risk factor for hypertension. Archives of internal medicine (1997).
[48]
Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion recognition using wireless signals. In MobiCom. ACM.
[49]
Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S. Jaakkola, and Matt T. Bianchi. 2017. Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture. In ICML.

Cited By

View all
  • (2024)Innovative Seatbelt-Integrated Metasurface Radar for Enhanced In-Car Healthcare MonitoringSensors10.3390/s2423749424:23(7494)Online publication date: 24-Nov-2024
  • (2024)Non-Contact Heart Rate Monitoring Method Based on Wi-Fi CSI SignalSensors10.3390/s2407211124:7(2111)Online publication date: 26-Mar-2024
  • (2024)Remote Multi-Person Heart Rate Monitoring with Smart Speakers: Overcoming Separation ConstraintSensors10.3390/s2402038224:2(382)Online publication date: 8-Jan-2024
  • Show More Cited By

Index Terms

  1. Extracting Multi-Person Respiration from Entangled RF Signals

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 2
    June 2018
    741 pages
    EISSN:2474-9567
    DOI:10.1145/3236498
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 05 July 2018
    Accepted: 01 April 2018
    Revised: 01 April 2018
    Received: 01 February 2018
    Published in IMWUT Volume 2, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Blind Source Separation
    2. Full-Night Monitoring
    3. Multi-Person Respiration Monitoring
    4. Wireless Sensing

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)300
    • Downloads (Last 6 weeks)36
    Reflects downloads up to 11 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Innovative Seatbelt-Integrated Metasurface Radar for Enhanced In-Car Healthcare MonitoringSensors10.3390/s2423749424:23(7494)Online publication date: 24-Nov-2024
    • (2024)Non-Contact Heart Rate Monitoring Method Based on Wi-Fi CSI SignalSensors10.3390/s2407211124:7(2111)Online publication date: 26-Mar-2024
    • (2024)Remote Multi-Person Heart Rate Monitoring with Smart Speakers: Overcoming Separation ConstraintSensors10.3390/s2402038224:2(382)Online publication date: 8-Jan-2024
    • (2024)DEWS: A Distributed Measurement Scheme for Efficient Wireless SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997288:4(1-34)Online publication date: 21-Nov-2024
    • (2024)Leveraging Attention-reinforced UWB Signals to Monitor Respiration during SleepACM Transactions on Sensor Networks10.1145/368055020:5(1-28)Online publication date: 26-Aug-2024
    • (2024)SpaceBeat: Identity-aware Multi-person Vital Signs Monitoring Using Commodity WiFiProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785908:3(1-23)Online publication date: 9-Sep-2024
    • (2024)RF-GymCare: Introducing Respiratory Prior for RF Sensing in Gym EnvironmentsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785688:3(1-28)Online publication date: 9-Sep-2024
    • (2024)EarSleep: In-ear Acoustic-based Physical and Physiological Activity Recognition for Sleep Stage DetectionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595958:2(1-31)Online publication date: 15-May-2024
    • (2024)Contactless Diseases Diagnoses Using Wireless Communication Sensing: Methods and Challenges SurveyACM Computing Surveys10.1145/364835256:9(1-29)Online publication date: 16-Feb-2024
    • (2024)SiWiS: Fine-grained Human Detection Using Single WiFi DeviceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690703(1439-1454)Online publication date: 4-Dec-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media