[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3408308.3427983acmotherconferencesArticle/Chapter ViewAbstractPublication PagesbuildsysConference Proceedingsconference-collections
research-article
Open access

Robust and Practical WiFi Human Sensing Using On-device Learning with a Domain Adaptive Model

Published: 18 November 2020 Publication History

Abstract

The ubiquity of WiFi devices combined with the ability to cover large areas, pass through walls, and detect subtle motions makes WiFi signals an ideal medium for sensing occupancy. While extremely promising, existing WiFi sensing solutions have not been rigorously tested outside of lab environments and don't often consider real-world constraints associated with non-expert installers, cost-effective platforms and long-term changes in the environment. This paper presents M-WiFi, a user-in-the-loop self-tuning framework for WiFi-based human presence detection with on-device learning and domain adaption capabilities that operates entirely on an embedded platform. M-WiFi robustly detects human presence by separating human-specific disturbances on WiFi signals from those of static objects, moving furniture or even pets. The high-level features of human presence are captured in an initial generalized classification model which adapts over time to a new building by selectively asking users to annotate a small number of critical time periods. We evaluate M-WiFi in 7 different houses, for a total of 100 days, with a mixture of pets and including periods of sleep and stationary activities. We show that our domain adaptive model can detect the human presence with an average accuracy of 90% in a completely new house after only 3 days of self-tuning and rapidly reaches a steady-state performance of 98% in long-term operations.

References

[1]
TPLink N600. https://openwrt.org/toh/tp-link/tl-wdr3600, 2020. [Online; accessed 10-January-2020].
[2]
Y. Agarwal, B. Balaji, R. Gupta, J. Lyles, M. Wei, and T. Weng. Occupancy-driven energy management for smart building automation. In ACM BuildSys, 2010.
[3]
I. B. Arief-Ang, F. D. Salim, and M. Hamilton. Da-hoc: semi-supervised domain adaptation for room occupancy prediction using co2 sensordata. In ACM BuildSys, 2017.
[4]
A. K. Das, P. H. Pathak, J. Jee, C.-N. Chuah, and P. Mohapatra. Non-intrusive multi-modal estimation of building occupancy. In ACM SenSys, 2017.
[5]
M. Farhadi, M. Ghasemi, S. Vrudhula, and Y. Yang. Enabling incremental knowledge transfer for object detection at the edge. In CVPR Workshop, 2020.
[6]
L. Gong, W. Yang, Z. Zhou, D. Man, H. Cai, X. Zhou, and Z. Yang. An adaptive wireless passive human detection via fine-grained physical layer information. Ad Hoc Networks, 38, 2016.
[7]
W. Jiang, C. Miao, F. Ma, S. Yao, Y. Wang, Y. Yuan, H. Xue, C. Song, X. Ma, D. Koutsonikolas, et al. Towards environment independent device free human activity recognition. In ACM MobiCom, 2018.
[8]
M. Kotaru, K. Joshi, D. Bharadia, and S. Katti. Spotfi: Decimeter level localization using wifi. In ACM SIGCOMM Computer Communication Review, volume 45, 2015.
[9]
R. B. Lehoucq, D. C. Sorensen, and C. Yang. ARPACK users' guide: solution of large-scale eigenvalue problems with implicitly restarted Arnoldi methods. SIAM, 1998.
[10]
X. Li, S. Li, D. Zhang, J. Xiong, Y. Wang, and H. Mei. Dynamic-music: accurate device-free indoor localization. In ACM UbiComp, 2016.
[11]
J. Liu, Y. Wang, Y. Chen, J. Yang, X. Chen, and J. Cheng. Tracking vital signs during sleep leveraging off-the-shelf wifi. In ACM MobiHoc, 2015.
[12]
W. Liu, X. Gao, L. Wang, and D. Wang. Bfp: Behavior-free passive motion detection using phy information. Wireless Personal Communications, 83(2), 2015.
[13]
X. Liu, J. Cao, S. Tang, J. Wen, and P. Guo. Contactless respiration monitoring via off-the-shelf wifi devices. IEEE TMC, 2015.
[14]
K. Qian, C. Wu, Z. Yang, Y. Liu, and Z. Zhou. Pads: Passive detection of moving targets with dynamic speed using phy layer information. In ICPADS. IEEE, 2014.
[15]
R. Schmidt. Multiple emitter location and signal parameter estimation. IEEE transactions on antennas and propagation, 1986.
[16]
O. Shih, P. Lazik, and A. Rowe. Aures: A wide-band ultrasonic occupancy sensing platform. In ACM BuildSys, 2016.
[17]
E. Soltanaghaei, A. Kalyanaraman, and K. Whitehouse. Peripheral wifi vision: Exploiting multipath reflections for more sensitive human sensing. In Proceedings of the 4th International on Workshop on Physical Analytics, 2017.
[18]
E. Soltanaghaei, A. Kalyanaraman, and K. Whitehouse. Multipath triangulation: Decimeter-level wifi localization and orientation with a single unaided receiver. In ACM MobiSys, 2018.
[19]
E. Soltanaghaei and K. Whitehouse. Walksense: Classifying home occupancy states using walkway sensing. In ACM BuildSys, 2016.
[20]
E. Soltanaghaei and K. Whitehouse. Practical occupancy detection for programmable and smart thermostats. Applied Energy, 220, 2018.
[21]
T. Teixeira, G. Dublon, and A. Savvides. A survey of human-sensing: Methods for detecting presence, count, location, track, and identity. ACM Computing Surveys, 5(1), 2010.
[22]
C. Truong, L. Oudre, and N. Vayatis. Selective review of offline change point detection methods. Signal Processing, 167, 2020.
[23]
P. Van Dorp and F. Groen. Feature-based human motion parameter estimation with radar. IET Radar, Sonar & Navigation, 2008.
[24]
Y. Xie, Z. Li, and M. Li. Precise power delay profiling with commodity wi-fi. IEEE TMC, 18(6), 2018.
[25]
T. Xin, B. Guo, Z. Wang, P. Wang, J. C. K. Lam, V. Li, and Z. Yu. Freesense: a robust approach for indoor human detection using wi-fi signals. UbiComp, 2(3), 2018.
[26]
D. B. Yang, L. J. Guibas, et al. Counting people in crowds with a real-time network of simple image sensors. page 122. IEEE, 2003.
[27]
Z. Yang and B. Becerik-Gerber. Cross-space building occupancy modeling by contextual information based learning. In ACM Buildsys, 2015.
[28]
F. Zhang, C. Wu, B. Wang, H.-Q. Lai, Y. Han, and K. R. Liu. Widetect: Robust motion detection with a statistical electromagnetic model. UbiComp, 3(3), 2019.
[29]
Z. Zhou, Z. Yang, C. Wu, L. Shangguan, and Y. Liu. Towards omnidirectional passive human detection. In 2013 Proceedings IEEE INFOCOM, pages 3057--3065. IEEE, 2013.
[30]
H. Zou, J. Yang, Y. Zhou, L. Xie, and C. J. Spanos. Robust wifi-enabled device-free gesture recognition via unsupervised adversarial domain adaptation. In ICCCN. IEEE, 2018.
[31]
H. Zou, Y. Zhou, J. Yang, H. Liu, H. P. Das, and C. J. Spanos. Consensus adversarial domain adaptation. In AAAI, 2019.

Cited By

View all
  • (2024)Mapping Thermal Footprints: Occupancy Estimation and Localization in Diverse Indoor Settings with Thermal ArraysProceedings of the 7th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies10.1145/3674829.3675059(38-49)Online publication date: 8-Jul-2024
  • (2024)Integrated Two-way Radar Backscatter Communication and Sensing with Low-power IoT TagsProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672226(327-339)Online publication date: 4-Aug-2024
  • (2024)Physical-Layer Privacy via Randomized Beamforming Against Adversarial Wi-Fi Sensing: Analysis, Implementation, and EvaluationIEEE Transactions on Wireless Communications10.1109/TWC.2024.348547723:12(19603-19617)Online publication date: Dec-2024
  • Show More Cited By

Index Terms

  1. Robust and Practical WiFi Human Sensing Using On-device Learning with a Domain Adaptive Model

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    BuildSys '20: Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation
    November 2020
    361 pages
    ISBN:9781450380614
    DOI:10.1145/3408308
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 November 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. CSI
    2. WiFi
    3. human sensing
    4. multipath propagation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • ARPA-E

    Conference

    BuildSys '20
    Sponsor:

    Acceptance Rates

    BuildSys '20 Paper Acceptance Rate 38 of 139 submissions, 27%;
    Overall Acceptance Rate 148 of 500 submissions, 30%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)500
    • Downloads (Last 6 weeks)40
    Reflects downloads up to 25 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Mapping Thermal Footprints: Occupancy Estimation and Localization in Diverse Indoor Settings with Thermal ArraysProceedings of the 7th ACM SIGCAS/SIGCHI Conference on Computing and Sustainable Societies10.1145/3674829.3675059(38-49)Online publication date: 8-Jul-2024
    • (2024)Integrated Two-way Radar Backscatter Communication and Sensing with Low-power IoT TagsProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672226(327-339)Online publication date: 4-Aug-2024
    • (2024)Physical-Layer Privacy via Randomized Beamforming Against Adversarial Wi-Fi Sensing: Analysis, Implementation, and EvaluationIEEE Transactions on Wireless Communications10.1109/TWC.2024.348547723:12(19603-19617)Online publication date: Dec-2024
    • (2024)Wi-Fi-Based Human Activity Recognition for Continuous, Whole-Room Monitoring of Motor Functions in Parkinson’s DiseaseIEEE Open Journal of Antennas and Propagation10.1109/OJAP.2024.33931175:3(788-799)Online publication date: Jun-2024
    • (2024)Doubling Down on Wireless Capacity: A Review of Integrated Circuits, Systems, and Networks for Full DuplexProceedings of the IEEE10.1109/JPROC.2024.3438755112:5(405-432)Online publication date: May-2024
    • (2024)Wi-MoID: Human and Nonhuman Motion Discrimination Using WiFi With Edge ComputingIEEE Internet of Things Journal10.1109/JIOT.2023.333954411:8(13900-13912)Online publication date: 15-Apr-2024
    • (2024)Continuous Multi-user Activity Tracking via Room-Scale mmWave Sensing2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN)10.1109/IPSN61024.2024.00018(163-175)Online publication date: 13-May-2024
    • (2024)Device-Free Indoor Localization of a Person Based on Channel State Information2024 International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM)10.1109/ICIEAM60818.2024.10553778(922-926)Online publication date: 20-May-2024
    • (2024)A Survey on Human Profile Information Inference via Wireless SignalsIEEE Communications Surveys & Tutorials10.1109/COMST.2024.337339726:4(2577-2610)Online publication date: Dec-2025
    • (2023)Mini-Batch Alignment: A Deep-Learning Model for Domain Factor-Independent Feature Extraction for Wi-Fi–CSI DataSensors10.3390/s2323953423:23(9534)Online publication date: 30-Nov-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media