research-article

WiNum: A WIFI Finger Gesture Recognition System Based on CSI

Authors:

Yong Zhang,

Kangle Xu,

Yujie WangAuthors Info & Claims

ICIT '19: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City

Pages 181 - 186

https://doi.org/10.1145/3377170.3377254

Published: 20 March 2020 Publication History

Get Access

Abstract

Gesture recognition is an important part of human-computer interaction, which enables people to interact naturally with the machine. In this paper, we design a gesture recognition system called WiNum based on Gradient Boosting Decision Tree (GBDT) algorithm, which uses the commercial router to extract channel state information (CSI) in WiFi environment. Our system uses discrete wavelet transform (DWT) to preprocess the data in order to eliminate the noise in the original data. We design an adaptive gesture segmentation algorithm (AGS) based on the difference in information entropy between action and non-action parts to segment gestures. Different from KNN, SVM and other machine learning methods, we use GBDT ensemble learning algorithm to realize finger gesture recognition. The experimental results show that our system has an average recognition accuracy of 91 % for finger gestures.

References

[1]

Z. Fu, J. Xu, Z. Zhu, A. X. Liu and X. Sun. 2019. Writing in the Air with WiFi Signals for Virtual Reality Devices. IEEE Transactions on Mobile Computing (Feb. 2019), 473--484. DOI= http://dx.doi.org/10.1109/TMC.2018.2831709.

Digital Library

Google Scholar

[2]

Al-qaness, Mohammed, F. Li. 2016. WiGeR: WiFi-based gesture recognition system. ISPRS International Journal of Geo-Information (2016), 92--108. DOI= http://dx.doi.org/10.3390/ijgi5060092.

Crossref

Google Scholar

[3]

S. S. Rautaray and A. Agrawal. A novel human computer interface based on hand gesture recognition using computer vision techniques. International Conference on Intelligent Interactive Technologies and Multimedia (2010), 292--296. DOI= http://dx.doi.org/10.1145/1963564.1963615.

Digital Library

Google Scholar

[4]

P. Kumar, J. Verma and S. Prasad. Hand data glove: a wearable real time device for human-computer interaction. International Journal of Advanced Science & Technology (Jun. 2012), 15--26.

Google Scholar

[5]

Duan, Shihong, Tianqing Yu, and Jie He. Widriver: Driver activity recognition system based on wifi csi. International Journal of Wireless Information Networks (2018), 146--156. DOI= http://dx.doi.org/10.1007/s10776-018-0389-0.

Crossref

Google Scholar

[6]

Halperin, Daniel, etal. Tool release: Gathering 802.11n traces with channel state information. ACMSIGCOMM Computer Communication Review (2011), 53--53. DOI= http://dx.doi.org/10.1145/1925861.1925870.

Digital Library

Google Scholar

[7]

Bansal, Abhishek, and Amit Kumar Kohli. Suppression of impulsive noise in OFDM system using imperfect channel state information. Optik-International Journal for Light and Electron Optics (2016), 2111--2115. DOI= http://dx.doi.org/10.1016/j.ijleo.2015.11.041

Crossref

Google Scholar

[8]

Q. Zhou, J. Xing, J. Li and Q. Yang. A Device-Free Number Gesture Recognition Approach Based on Deep Learning. International Conference on Computational Intelligence and Security (CIS) (2016), 57--63. DOI= http://dx.doi.org/10.1109/CIS.2016.0022.

Crossref

Google Scholar

[9]

D. Man, W. Yang, X. Wang, J. Lv, X. Du and M. Yu, PWiG: A Phase-based Wireless Gesture Recognition System, International Conference on Computing, Networking and Communications (ICNC), Maui, HI, 2018, pp. 837--842. DOI= http://dx.doi.org/10.1109/ICCNC.2018.8390335.

Crossref

Google Scholar

[10]

Wang, Fangxin, et al. Channel Selective Activity Recognition with WiFi: A Deep Learning Approach Exploring Wideband Information. IEEE Transactions on Network Science & Engineering (2018), 1--1. DOI= http://dx.doi.org/10.1109/TNSE.2018.2825144.

Crossref

Google Scholar

Cited By

View all

Zheng XYang KXiong JLiu LMa H(2024)Pushing the Limits of WiFi Sensing With Low Transmission RatesIEEE Transactions on Mobile Computing10.1109/TMC.2024.337404623:11(10265-10279)Online publication date: Nov-2024
https://doi.org/10.1109/TMC.2024.3374046
Dang XKe WHao ZJin PDeng HSheng Y(2023)mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point CloudSensors10.3390/s2315681623:15(6816)Online publication date: 31-Jul-2023
https://doi.org/10.3390/s23156816
Dang XBai YHao ZLiu G(2022)Wi-GC: A Deep Spatiotemporal Gesture Recognition Method Based on Wi-Fi SignalApplied Sciences10.3390/app12201042512:20(10425)Online publication date: 16-Oct-2022
https://doi.org/10.3390/app122010425
Show More Cited By

Index Terms

WiNum: A WIFI Finger Gesture Recognition System Based on CSI
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

SignFi: Sign Language Recognition Using WiFi

We propose SignFi to recognize sign language gestures using WiFi. SignFi uses Channel State Information (CSI) measured by WiFi packets as the input and a Convolutional Neural Network (CNN) as the classification algorithm. Existing WiFi-based sign gesture ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
BackHand: Sensing Hand Gestures via Back of the Hand
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

In this paper, we explore using the back of hands for sensing hand gestures, which interferes less than glove-based approaches and provides better recognition than sensing at wrists and forearms. Our prototype, BackHand, uses an array of strain gauge ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICIT '19: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City

December 2019

601 pages

ISBN:9781450376631

DOI:10.1145/3377170

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Shanghai Jiao Tong University: Shanghai Jiao Tong University
The Hong Kong Polytechnic: The Hong Kong Polytechnic University
University of Malaya: University of Malaya

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 March 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Natural Science Foundation of China

Conference

ICIT 2019

ICIT 2019: IoT and Smart City

December 20 - 23, 2019

Shanghai, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
119
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zheng XYang KXiong JLiu LMa H(2024)Pushing the Limits of WiFi Sensing With Low Transmission RatesIEEE Transactions on Mobile Computing10.1109/TMC.2024.337404623:11(10265-10279)Online publication date: Nov-2024
https://doi.org/10.1109/TMC.2024.3374046
Dang XKe WHao ZJin PDeng HSheng Y(2023)mm-TPG: Traffic Policemen Gesture Recognition Based on Millimeter Wave Radar Point CloudSensors10.3390/s2315681623:15(6816)Online publication date: 31-Jul-2023
https://doi.org/10.3390/s23156816
Dang XBai YHao ZLiu G(2022)Wi-GC: A Deep Spatiotemporal Gesture Recognition Method Based on Wi-Fi SignalApplied Sciences10.3390/app12201042512:20(10425)Online publication date: 16-Oct-2022
https://doi.org/10.3390/app122010425
Yang KZheng XXiong JLiu LMa H(2022)WiImg: Pushing the Limit of WiFi Sensing with Low Transmission Rates2022 19th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SECON55815.2022.9918170(1-9)Online publication date: 20-Sep-2022
https://doi.org/10.1109/SECON55815.2022.9918170
Wang HZhang JLi YWang L(2022)SignGest: Sign Language Recognition Using Acoustic Signals on Smartphones2022 IEEE 20th International Conference on Embedded and Ubiquitous Computing (EUC)10.1109/EUC57774.2022.00019(60-65)Online publication date: Dec-2022
https://doi.org/10.1109/EUC57774.2022.00019
Hernandez SBulut E(2022)WiFi Sensing on the Edge: Signal Processing Techniques and Challenges for Real-World SystemsIEEE Communications Surveys & Tutorials10.1109/COMST.2022.320914425:1(46-76)Online publication date: 23-Sep-2022
https://dl.acm.org/doi/10.1109/COMST.2022.3209144

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

SignFi: Sign Language Recognition Using WiFi

Multi-scenario gesture recognition using Kinect

BackHand: Sensing Hand Gestures via Back of the Hand