SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization
<p>Geometry of Fresnel Zones.</p> "> Figure 2
<p>Illustration of SWiLoc System.</p> "> Figure 3
<p>Towards Solving Unreliable Direction Problem. (<b>a</b>) Unreliable Direction using 2 receivers. (<b>b</b>) SWiLoc solves unreliable direction using 4 receivers.</p> "> Figure 4
<p>System Workflow of SWiLoc.</p> "> Figure 5
<p>Geometrical Derivation of SWiLoc using Triangle.</p> "> Figure 6
<p>The <span class="html-italic">m</span>th and <span class="html-italic">n</span>th Fresnel Zone for Rx2 and Rx4.</p> "> Figure 7
<p>Mapping Phone Orientation to User Direction.</p> "> Figure 8
<p>LoS Crossing Detection.</p> "> Figure 9
<p>Before and After CSI Smoothing.</p> "> Figure 10
<p>Testbed Setup.</p> "> Figure 11
<p>Phase 1 Accuracy in 2 Different Environments.</p> "> Figure 12
<p>SWiLoc Performance in Continuous Traces.</p> "> Figure 13
<p>Localization Error for Continuous Trace 1 & 2.</p> "> Figure 14
<p>CDF of Different Phone Holding Positions, Comparing SWiLoc with Humaine and Android API.</p> "> Figure 15
<p>Localization Error for Different State-of-the-art methods (Holding Phone on Hand Palm).</p> "> Figure 16
<p>Paths with Different LoS Crossing Locations.</p> "> Figure 17
<p>Impact of LoS Crossing Locations and Distances.</p> "> Figure 18
<p>Impact of Direction Error on Loc. Accuracy.</p> ">
Abstract
:1. Introduction
- In this paper, we introduce SWiLoc (Smartphone and WiFi-based Localization), a novel direction correction system that leverages passive WiFi sensing to form Correction Zones for refining smartphone-based user direction estimates. Our two-phase approach not only accurately measures the user’s walking directions when they pass through a correction zone but also utilizes these measured directions to estimate their successive directions outside correction zones. This is done by first establishing a correlation in Phase 1 and using this correlation in Phase 2.
- Building on the first contribution, we extend SWiLoc’s capabilities by implementing an accurate localization technique that uses the corrected directions to achieve precise user localization. This extension enhances the system’s utility by enabling continuous and accurate tracking of the user’s movements, providing a robust solution for applications requiring high localization accuracy.
- Our third contribution is the resolution of unreliable walking directions through our innovative and distinctive hardware configurations. We discuss and resolve the unreliable direction problem in this paper. Our model is based on the Fresnel zone-based approach that not only ensures reliable direction estimations in challenging scenarios but also significantly enhances localization accuracy.
- Our system undergoes rigorous analysis and evaluation across two real-world settings, where its performance is benchmarked against state-of-the-art methods. We thoroughly assess how various factors—such as environmental conditions, ways the phone is held, walking directions, and varying locations and distances—affect the precision of our method. The results demonstrate that SWiLoc consistently outperforms other existing methods in both direction estimation and localization, regardless of whether they utilize WiFi sensing or smartphone sensor fusion.
2. Related Works and Background
2.1. Channel State Information (CSI)
2.2. Pedestrian Dead Reckoning (PDR)
2.3. Smartphone Sensor Fusion Based Direction and Location Estimation
2.4. Calibration-Based Direction and Location Estimation
2.5. Direction and Location Estimation Using WiFi
3. SWiLoc System
3.1. System Overview
3.2. SWiLoc Design Considerations
- (1)
- To solve the unreliable direction problem, SWiLoc incorporates additional receivers as shown in Figure 3b. As two receivers placed perpendicular to each other may provide inaccurate estimation, we use opposite receivers (either Rx2 and Rx4 or Rx1 and Rx3, depending on the user’s direction) for direction estimation.
- (2)
- In order to adapt to the changes in system hardware setup, SWiLoc utilizes accurate walking distance data from smartphones to improve the precision and reliability of WiFi sensing. Rather than relying on ratios, SWiLoc uses the geometrical relationship between the user’s movement and its effect on the Fresnel zones. This method allows SWiLoc to compute direction and location accurately without resorting to approximations.
4. Methodology
4.1. Workflow of SWiLoc
- Start:
- The central server integrates a Network Time Protocol (NTP) to ensure time synchronization between the smartphone and all four receivers.
- Phase 1:
- 2.
- A user with a smartphone enters a correction zone and crosses the Line-of-Sight between a pair of WiFi transceivers at time . This crossing event is identified through CSI analysis, details of which are elaborated in our system implementation section.
- 3.
- Following CSI analysis, the server transmits to the smartphone, which continues to gather data from the motion sensor as the user walks. This data includes the user’s step count, the phone’s orientation (pitch, roll, and azimuth), and the timestamp for each step, all of which are processed and recorded by the smartphone.
- 4.
- The smartphone transmits the time and distance d to the server, where represents the time taken for the user to walk k additional steps after crossing the LoS and d denotes the distance traveled between and . The value of k is predetermined and d is calculated using the individual step length of each user.
- 5.
- 6.
- The server returns the calculated direction to the smartphone.
- Phase 2:
- 7.
- The phone receives the user’s walking direction and maps the phone’s orientation to the user’s walking direction during and by using Equation (4).
- 8.
- User continues walking, relying on the mapping formed in the previous step to infer the user’s walking direction from phone’s orientation.
- 9.
- Finally, the phone computes user’s location using the corrected walking direction. Phase 1 repeats when the user moves into a next correction zone.
4.2. Computation of Direction in Correction Zone
4.3. Phone-Based Direction Estimation
4.4. Location Estimation
4.4.1. Step Detection
4.4.2. Step Length Estimation
4.4.3. Location Calculation
5. System Implementation
5.1. Hardware Setup
5.2. Software Implementation
5.2.1. LoS Crossing Detection
5.2.2. CSI Fluctuation Count
5.2.3. Direction Calculation
5.2.4. Location Calculation
5.2.5. SWiLoc App Implementation
6. Evaluation
6.1. Testbed Setup
6.2. Performance Evaluation for Phase 1 Only
6.3. Performance Evaluation for SWiLoc
6.4. Sensitivity Analysis of SWiLoc
6.4.1. Impact of Varying LoS Crossing Locations
6.4.2. Impact of Distance d on Direction Accuracy
6.4.3. Impact of Direction Accuracy on Localization Accuracy
6.5. Discussion
- (1)
- Requirements on Physical Deployments: Similar to other RF-based human sensing applications like patient monitoring and gesture recognition, SWiLoc is affected by complex multi-path environments, and its accuracy significantly decreases when two individuals enter the same correction zone at the same time. Additionally, it is necessary for the pedestrian to walk at least 0.5 m after crossing the LoS. Therefore, when implementing SWiLoc, developers must ensure these conditions are met to maintain system effectiveness.
- (2)
- Assumption on Phone’s Orientation: Phase 2 of SWiLoc relies on the assumption that the mapping between user’s direction and phone’s orientation won’t change. However, sometimes a pedestrian may change how they carry the phone. Considering this, it is necessary to deploy multiple correction zones to update the mapping. Besides, as a future work direction, we plan to integrate our approach with other sensor fusion-based approaches such as WalkCompass.
- (3)
- Configuration of Correction Zone: Configuring correction zones effectively is crucial for ensuring reliable and accurate localization. The coverage area of each correction zone is primarily determined by the sensing capabilities of each locations and the distance between the deployed transceivers. Based on recent advancements in CSI based sensing, as noted in the latest literature, transceivers can maintain effective sensing zone over distances up to 40 m [43]. This extended range allows us to design larger correction zones, thereby reducing the number of zones required to cover a given space comprehensively.To this end, to determine the optimal number and placement of correction zones, we can employ a systematic approach that considers the layout of the indoor environment and the typical movement patterns of users within it. The placement strategy aims to maximize coverage, ensuring that at any point within the environment, a pedestrian’s mobile phone can reliably connect to at least one correction zone. This is particularly important given the random nature of changes in phone posture and orientation as users move.
- (4)
- Applicability of SWiLoc in Diverse Indoor Environments: Our SWiLoc system employs a seamless integration with server-based corrections, which are delivered to users via an existing WiFi connection. Users are not required to be aware of the server or the technicalities of correction zones; instead, they experience an automated and continuous improvement in direction and location accuracy as they move within the coverage area. This setup ensures that the localization system is user-friendly and unobtrusive, leveraging WiFi connectivity to provide necessary updates and corrections from the server. This design is particularly effective in environments where WiFi is readily available, allowing for broad application in various indoor settings such as shopping centers, offices, hospitals, airports, museums etc. without the need for specialized knowledge or interaction from the user.
7. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Farahsari, P.S.; Farahzadi, A.; Rezazadeh, J.; Bagheri, A. A survey on indoor positioning systems for IoT-based applications. IEEE Internet Things J. 2022, 9, 7680–7699. [Google Scholar] [CrossRef]
- Zafari, F.; Gkelias, A.; Leung, K.K. A survey of indoor localization systems and technologies. IEEE Commun. Surv. Tutorials 2019, 21, 2568–2599. [Google Scholar] [CrossRef]
- Xue, W.; Qiu, W.; Hua, X.; Yu, K. Improved Wi-Fi RSSI measurement for indoor localization. IEEE Sensors J. 2017, 17, 2224–2230. [Google Scholar] [CrossRef]
- Sung, K.; Kim, H. Bayesian navigation system with particle filtering and dead reckoning in urban canyon environments. In Proceedings of the 2012 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), Seoul, Republic of Korea, 18–21 June 2012; pp. 73–75. [Google Scholar]
- Spachos, P.; Plataniotis, K.N. BLE beacons for indoor positioning at an interactive IoT-based smart museum. IEEE Syst. J. 2020, 14, 3483–3493. [Google Scholar] [CrossRef]
- Mulloni, A.; Wagner, D.; Barakonyi, I.; Schmalstieg, D. Indoor positioning and navigation with camera phones. IEEE Pervasive Comput. 2009, 8, 22–31. [Google Scholar] [CrossRef]
- Mohssen, N.; Momtaz, R.; Aly, H.; Youssef, M. It’s the human that matters: Accurate user orientation estimation for mobile computing applications. arXiv 2014, arXiv:1411.2156. [Google Scholar]
- Yu, N.; Zhan, X.; Zhao, S.; Wu, Y.; Feng, R. A precise dead reckoning algorithm based on Bluetooth and multiple sensors. IEEE Internet Things J. 2017, 5, 336–351. [Google Scholar] [CrossRef]
- Hussain, B.; Wang, Y.; Chen, R.; Cheng, H.C.; Yue, C.P. Lidr: Visible-light-communication-assisted dead reckoning for accurate indoor localization. IEEE Internet Things J. 2022, 9, 15742–15755. [Google Scholar] [CrossRef]
- Chen, H.; Li, F.; Wang, Y. SoundMark: Accurate indoor localization via peer-assisted dead reckoning. IEEE Internet Things J. 2018, 5, 4803–4815. [Google Scholar] [CrossRef]
- Yan, D.; Shi, C.; Li, T.; Li, Y. FlexPDR: Fully flexible pedestrian dead reckoning using online multimode recognition and time-series decomposition. IEEE Internet Things J. 2022, 9, 15240–15254. [Google Scholar] [CrossRef]
- Perul, J.; Renaudin, V. Learning individual models to estimate the walking direction of mobile phone users. IEEE Sens. J. 2019, 19, 12306–12315. [Google Scholar] [CrossRef]
- Xiao, Z.; Wen, H.; Markham, A.; Trigoni, N. Robust indoor positioning with lifelong learning. IEEE J. Sel. Areas Commun. 2015, 33, 2287–2301. [Google Scholar] [CrossRef]
- Lee, J.S.; Huang, S.M. An experimental heuristic approach to multi-pose pedestrian dead reckoning without using magnetometers for indoor localization. IEEE Sens. J. 2019, 19, 9532–9542. [Google Scholar] [CrossRef]
- Wang, Q.; Luo, H.; Xiong, H.; Men, A.; Zhao, F.; Xia, M.; Ou, C. Pedestrian dead reckoning based on walking pattern recognition and online magnetic fingerprint trajectory calibration. IEEE Internet Things J. 2020, 8, 2011–2026. [Google Scholar] [CrossRef]
- Mottakin, K.; Davuluri, K.; Song, Z. SWiDir: Enhancing Smartphone-based Walking Direction Estimation with Passive WiFi Sensing. In Proceedings of the 2023 IEEE 20th International Conference on Mobile Ad Hoc and Smart Systems (MASS), Toronto, ON, Canada, 25–27 September 2023; pp. 599–605. [Google Scholar]
- Lin, Y.; Dong, W.; Li, B.; Gao, Y. TinyCSI: A Rapid Development Framework for CSI-based Sensing Applications. In Proceedings of the 2020 IEEE 17th International Conference on Mobile Ad Hoc and Sensor Systems (MASS), Virtual Conference, 10–13 December 2020; pp. 549–557. [Google Scholar] [CrossRef]
- Gringoli, F.; Schulz, M.; Link, J.; Hollick, M. Free your CSI: A channel state information extraction platform for modern Wi-Fi chipsets. In Proceedings of the 13th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization, Los Cabos, Mexico, 25 October 2019; pp. 21–28. [Google Scholar]
- Zhou, N.; Sun, W.; Liang, M. Human Activity Recognition based on WiFi Signal Using Deep Neural Network. In Proceedings of the International Conference on Smart City and Informatization (iSCI), Guangzhou, China, 29 December 2020–1 January 2021; pp. 26–30. [Google Scholar]
- Gu, F.; Khoshelham, K.; Shang, J.; Yu, F.; Wei, Z. Robust and accurate smartphone-based step counting for indoor localization. IEEE Sens. J. 2017, 17, 3453–3460. [Google Scholar] [CrossRef]
- Vandermeeren, S.; Bruneel, H.; Steendam, H. Feature selection for machine learning based step length estimation algorithms. Sensors 2020, 20, 778. [Google Scholar] [CrossRef] [PubMed]
- Bo, F.; Li, J.; Wang, W. Mode-Independent Stride Length Estimation With IMUs in Smartphones. IEEE Sens. J. 2022, 22, 5824–5833. [Google Scholar] [CrossRef]
- Roy, N.; Wang, H.; Roy Choudhury, R. I am a smartphone and i can tell my user’s walking direction. In Proceedings of the 12th Annual International Conference on Mobile Systems, Applications, and Services, Bretton Woods, NH, USA, 16–19 June 2014; pp. 329–342. [Google Scholar]
- Kang, W.; Han, Y. SmartPDR: Smartphone-based pedestrian dead reckoning for indoor localization. IEEE Sens. J. 2014, 15, 2906–2916. [Google Scholar] [CrossRef]
- Deng, Z.A.; Wang, G.; Hu, Y.; Wu, D. Heading estimation for indoor pedestrian navigation using a smartphone in the pocket. Sensors 2015, 15, 21518–21536. [Google Scholar] [CrossRef] [PubMed]
- Hu, Y.; Qian, F.; Yin, Z.; Li, Z.; Ji, Z.; Han, Y.; Xu, Q.; Jiang, W. Experience: Practical indoor localization for malls. In Proceedings of the MobiCom’22, New York, NY, USA, 3–7 October 2022; pp. 82–93. [Google Scholar]
- Chen, Z.; Zhu, Q.; Soh, Y.C. Smartphone inertial sensor-based indoor localization and tracking with iBeacon corrections. IEEE Trans. Ind. Inform. 2016, 12, 1540–1549. [Google Scholar] [CrossRef]
- Wu, D.; Zhang, D.; Xu, C.; Wang, Y.; Wang, H. WiDir: Walking direction estimation using wireless signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 12–16 September 2016; pp. 351–362. [Google Scholar]
- Qian, K.; Wu, C.; Yang, Z.; Liu, Y.; Jamieson, K. Widar: Decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi. In Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Chennai, India, 10–14 July 2017; pp. 1–10. [Google Scholar]
- Qian, K.; Wu, C.; Zhang, Y.; Zhang, G.; Yang, Z.; Liu, Y. Widar2.0: Passive human tracking with a single Wi-Fi link. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, Munich, Germany, 10–15 June 2018; pp. 350–361. [Google Scholar]
- Ahad, M.A.R.; Mahbub, U.; Rahman, T. Contactless Human Activity Analysis; Springer: Berlin/Heidelberg, Germany, 2021; Volume 200. [Google Scholar]
- Fan, Q.; Zhang, H.; Pan, P.; Zhuang, X.; Jia, J.; Zhang, P.; Zhao, Z.; Zhu, G.; Tang, Y. Improved pedestrian dead reckoning based on a robust adaptive Kalman filter for indoor inertial location system. Sensors 2019, 19, 294. [Google Scholar] [CrossRef] [PubMed]
- Schafer, R.W. What Is a Savitzky-Golay Filter? [Lecture Notes]. IEEE Signal Process. Mag. 2011, 28, 111–117. [Google Scholar] [CrossRef]
- Iutinvg. Simple Android Compass Implementation. GitHub Repository. Available online: https://github.com/iutinvg/compass (accessed on 30 September 2023).
- Pizarro, A.B.; Beltrán, J.P.; Cominelli, M.; Gringoli, F.; Widmer, J. Accurate ubiquitous localization with off-the-shelf IEEE 802.11 ac devices. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services, Virtual Conference, 24 June–2 July 2021; pp. 241–254. [Google Scholar]
- Kotaru, M.; Joshi, K.; Bharadia, D.; Katti, S. Spotfi: Decimeter level localization using wifi. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication, London, UK, 17–21 August 2015; pp. 269–282. [Google Scholar]
- Rea, M.; Abrudan, T.E.; Giustiniano, D.; Claussen, H.; Kolmonen, V.M. Smartphone positioning with radio measurements from a single wifi access point. In Proceedings of the 15th international Conference on Emerging Networking Experiments and Technologies, Orlando, FL, USA, 9–12 December 2019; pp. 200–206. [Google Scholar]
- Jiokeng, K.; Jakllari, G.; Tchana, A.; Beylot, A.L. When FTM discovered MUSIC: Accurate WiFi-based ranging in the presence of multipath. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications, Virtual Conference, 6–9 July 2020; pp. 1857–1866. [Google Scholar]
- Chen, Z.; Zou, H.; Jiang, H.; Zhu, Q.; Soh, Y.C.; Xie, L. Fusion of WiFi, smartphone sensors and landmarks using the Kalman filter for indoor localization. Sensors 2015, 15, 715–732. [Google Scholar] [CrossRef] [PubMed]
- Sun, M.; Wang, Y.; Xu, S.; Cao, H.; Si, M. Indoor positioning integrating PDR/geomagnetic positioning based on the genetic-particle filter. Appl. Sci. 2020, 10, 668. [Google Scholar] [CrossRef]
- Zhang, M.; Jia, J.; Chen, J.; Deng, Y.; Wang, X.; Aghvami, A.H. Indoor localization fusing wifi with smartphone inertial sensors using lstm networks. IEEE Internet Things J. 2021, 8, 13608–13623. [Google Scholar] [CrossRef]
- Halperin, D.; Hu, W.; Sheth, A.; Wetherall, D. Tool release: Gathering 802.11 n traces with channel state information. ACM SIGCOMM Comput. Commun. Rev. 2011, 41, 53. [Google Scholar] [CrossRef]
- Li, Y.; Wu, D.; Zhang, J.; Xu, X.; Xie, Y.; Gu, T.; Zhang, D. DiverSense: Maximizing Wi-Fi sensing range leveraging signal diversity. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2022, 6, 1–28. [Google Scholar] [CrossRef]
Approaches | 75th Percentile Error (in degree) | Median Error (in degree) |
---|---|---|
WiDir | 23 | 10 |
WalkCompass | 14.2 | 8 |
WiDar | 18 | 5 |
SWiLoc (Phase 1) | 8.89 | 6 |
Approaches | 80th Percentile Localization Error (m) | Base Sensing Method |
---|---|---|
UbiLocate | 2.2 | Passive |
Spotfi | 6.0 | Passive |
Spring | 3.7 | Passive |
Fusic | 3.4 | Passive |
Kalman-filter based | 4.6 | Active Fusion |
PDRLoc | 6.71 | Active Fusion |
Particle-filter based | 2.21 | Active Fusion |
LSTMLoc | 2.36 | Active Fusion (Training-based) |
SWiLoc (Phase 1 & 2) | 1.12 | Active Fusion & Passive, Training free |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Mottakin, K.; Davuluri, K.; Allison, M.; Song, Z. SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization. Sensors 2024, 24, 6327. https://doi.org/10.3390/s24196327
Mottakin K, Davuluri K, Allison M, Song Z. SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization. Sensors. 2024; 24(19):6327. https://doi.org/10.3390/s24196327
Chicago/Turabian StyleMottakin, Khairul, Kiran Davuluri, Mark Allison, and Zheng Song. 2024. "SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization" Sensors 24, no. 19: 6327. https://doi.org/10.3390/s24196327
APA StyleMottakin, K., Davuluri, K., Allison, M., & Song, Z. (2024). SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization. Sensors, 24(19), 6327. https://doi.org/10.3390/s24196327