Understanding Localization by a Tailored GPT
Pages 318 - 330
Abstract
Conventional deep learning approaches for indoor localization often suffer from their reliance on high-quality training samples and display limited adaptability across varied scenarios. To address these challenges, we repurpose the Transformer model, celebrated for its profound contextual insights, to explore the underlying principles of indoor localization. Our microbenchmark results compellingly demonstrate the superiority of our approach, showing improvements of 30% to 70% across a diverse set of 50 scenarios compared to other state-of-the-art methods. In conclusion, we propose a specialized Generative Pre-training Transformer (GPT) variant, termed LocGPT, configured with 36 million parameters that are tailored to facilitate transfer learning. By fine-tuning this pre-trained model, we achieve near-par accuracy using merely half the conventional dataset, thereby heralding a pioneering stride in transfer learning within the indoor localization domain.
References
[1]
L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu, "Tagoram: Real-time tracking of mobile rfid tags to high precision using cots devices," in Proc. of ACM MobiCom, 2014, pp. 237--248.
[2]
Y. Ma, N. Selby, and F. Adib, "Minding the billions: Ultra-wideband localization for deployed rfid tags," in Proc. of ACM MobiCom, 2017, pp. 248--260.
[3]
Y. Xie, J. Xiong, M. Li, and K. Jamieson, "md-track: Leveraging multi-dimensionality for passive indoor wi-fi tracking," in Proc. of ACM MobiCom, 2019, pp. 1--16.
[4]
Y. Xie, Y. Zhang, J. C. Liando, and M. Li, "Swan: Stitched wi-fi antennas," in Proc. of ACM MobiCom, 2018.
[5]
F. Adib, Z. Kabelac, D. Katabi, and R. C. Miller, "3d tracking via body radio reflections," in Proc. of USENIX NSDI, vol. 14, 2013.
[6]
F. Adib, Z. Kabelac, and D. Katabi, "Multi-person motion tracking via rf body reflections," in Proc. of USENIX NSDI, 2015.
[7]
M. Zhao, Y. Tian, H. Zhao, M. A. Alsheikh, T. Li, R. Hristov, Z. Kabelac, D. Katabi, and A. Torralba, "Rf-based 3d skeletons," in Proc. of ACM SIGCOMM, 2018, pp. 267--281.
[8]
M. Zhao, T. Li, M. Abu Alsheikh, Y. Tian, H. Zhao, A. Torralba, and D. Katabi, "Through-wall human pose estimation using radio signals," in Proc. of IEEE/CVF CVPR, 2018, pp. 7356--7365.
[9]
Y. Ma and E. C. Kan, "Accurate indoor ranging by broadband harmonic generation in passive nltl backscatter tags," IEEE Transactions on Microwave Theory and Techniques, vol. 62, no. 5, pp. 1249--1261, 2014.
[10]
X. Hui and E. C. Kan, "Radio ranging with ultrahigh resolution using a harmonic radio-frequency identification system," Nature Electronics, vol. 2, no. 3, p. 125, 2019.
[11]
A. Haniz, G. K. Tran, K. Saito, K. Sakaguchi, J.-i. Takada, D. Hayashi, T. Yamaguchi, and S. Arata, "A novel phase-difference fingerprinting technique for localization of unknown emitters," IEEE Transactions on Vehicular Technology, vol. 66, no. 9, pp. 8445--8457, 2017.
[12]
M. Youssef and A. Agrawala, "The horus wlan location determination system," in Proc. of ACM MobiSys, 2005, pp. 205--218.
[13]
S. Sen, B. Radunovic, R. R. Choudhury, and T. Minka, "You are facing the mona lisa: Spot localization using phy layer information," in Proc. of ACM MobiSys, 2012, pp. 183--196.
[14]
Z. Yang, C. Wu, and Y. Liu, "Locating in fingerprint space: wireless indoor localization with little human intervention," in Proc. of ACM MobiCom, 2012, pp. 269--280.
[15]
H. Liu, Y. Gan, J. Yang, S. Sidhom, Y. Wang, Y. Chen, and F. Ye, "Push the limit of wifi based localization for smartphones," in Proc. of ACM MobiCom, 2012, pp. 305--316.
[16]
H. Wang, S. Sen, A. Elgohary, M. Farid, M. Youssef, and R. R. Choudhury, "No need to war-drive: Unsupervised indoor localization," in Proc. of ACM MobiSys, 2012, pp. 197--210.
[17]
L. Ni, Y. Liu, Y. Lau, and A. Patil, "Landmarc: Indoor location sensing using active rfid," Wireless networks, 2004.
[18]
J. Wang and D. Katabi, "Dude, where's my card? rfid positioning that works with multipath and non-line of sight," in Proc. of ACM SIGCOMM, 2013, pp. 51--62.
[19]
S. J. Pan, V. W. Zheng, Q. Yang, and D. H. Hu, "Transfer learning for wifi-based indoor localization," in Proc. of ACM AAAI workshop, vol. 6, 2008.
[20]
R. Ayyalasomayajula, A. Arun, C. Wu, S. Sharma, A. R. Sethi, D. Vasisht, and D. Bharadia, "Deep learning based wireless localization for indoor navigation," in Proc. of ACM MobiCom, 2020, pp. 1--14.
[21]
Z. An, Q. Lin, P. Li, and L. Yang, "General-purpose deep tracking platform across protocols for the internet of things," in Proc. of ACM MobiSys, 2020, pp. 94--106.
[22]
C. Li, Z. Cao, and Y. Liu, "Deep ai enabled ubiquitous wireless sensing: A survey," ACM Computing Surveys (CSUR), vol. 54, no. 2, pp. 1--35, 2021.
[23]
W. Qian, F. Lauri, and F. Gechter, "Supervised and semi-supervised deep probabilistic models for indoor positioning problems," Neurocomputing, vol. 435, pp. 228--238, 2021.
[24]
C. Zhan, M. Ghaderibaneh, P. Sahu, and H. Gupta, "Deepmtl: Deep learning based multiple transmitter localization," in Proc. of IEEE WoWMoM, 2021, pp. 41--50.
[25]
Y. Ma, Z. Luo, C. Steiger, G. Traverso, and F. Adib, "Enabling deep-tissue networking for miniature medical devices," in Proc. of ACM SIGCOMM, 2018, pp. 417--431.
[26]
S. M. Nguyen, D. V. Le, and P. J. Havinga, "Learning the world from its words: Anchor-agnostic transformers for fingerprint-based indoor localization," in Proc. of IEEE PerCom, 2023, pp. 150--159.
[27]
X. Wang, J. Zhang, S. Mao, S. C. Periaswamy, and J. Patton, "Locating multiple rfid tags with swin transformer-based rf hologram tensor filtering," in Proc. of IEEE VTC, 2022, pp. 1--2.
[28]
OpenAI, "Chatgpt," https://openai.com/chatgpt, 2023.
[29]
Meta, "Large language model (llama) at meta ai," https://ai.meta.com/blog/large-language-model-llama-meta-ai/, 2023.
[30]
M. Comiter and H. Kung, "Localization convolutional neural networks using angle of arrival images," in Proc. of IEEE GLOBECOM. IEEE, 2018, pp. 1--7.
[31]
X. Wang, X. Wang, and S. Mao, "Deep convolutional neural networks for indoor localization with csi images," IEEE Transactions on Network Science and Engineering, vol. 7, no. 1, pp. 316--327, 2018.
[32]
"USRP X310," https://www.ettus.com/all-products/x310-kit/, 2020.
[33]
J. Kimionis, A. Bletsas, and J. N. Sahalos, "Increased range bistatic scatter radio," IEEE Transactions on Communications, vol. 62, no. 3, pp. 1091--1104, 2014.
[34]
S. Labs, "Direction finding using bluetooth low energy," Application Note, 2021. [Online]. Available: https://www.silabs.com/documents/public/application-notes/an1298-direction-finding-using-bluetooth-low-energy.pdf
[35]
E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, "Lora: Low-rank adaptation of large language models," arXiv preprint arXiv:2106.09685, 2021.
[36]
L. M. Ni, Y. Liu, Y. C. Lau, and A. P. Patil, "Landmarc: Indoor location sensing using active rfid," in Proc. of IEEE PerCom. IEEE, 2003, pp. 407--415.
[37]
Y. Ma, N. Selby, and F. Adib, "Drone relays for battery-free networks," in Proc. of ACM SIGCOMM, 2017, pp. 335--347.
[38]
Z. Yang, Z. Zhou, and Y. Liu, "From rssi to csi: Indoor localization via channel response," ACM Computing Surveys (CSUR), vol. 46, no. 2, pp. 1--32, 2013.
[39]
A. T. Mariakakis, S. Sen, J. Lee, and K.-H. Kim, "Sail: Single access point-based indoor localization," in Proc. of ACM MobiSys, 2014, pp. 315--328.
[40]
R. Ayyalasomayajula, D. Vasisht, and D. Bharadia, "Bloc: Csi-based accurate localization for ble tags," in Proc. of ACM CoNEXT, 2018, pp. 126--138.
[41]
M. Kotaru, K. Joshi, D. Bharadia, and S. Katti, "Spotfi: Decimeter level localization using wifi," in Proc. of ACM SIGCOMM, 2015, pp. 269--282.
[42]
J. Xiong and K. Jamieson, "Arraytrack: A fine-grained indoor location system," in Proc. of USENIX NSDI, 2013, pp. 71--84.
[43]
J. Gjengset, J. Xiong, G. McPhillips, and K. Jamieson, "Phaser: Enabling phased array signal processing on commodity wifi access points," in Proc. of ACM Mobicom, 2014, pp. 153--164.
[44]
Y. Zheng, Y. Zhang, K. Qian, G. Zhang, Y. Liu, C. Wu, and Z. Yang, "Zero-effort cross-domain gesture recognition with wi-fi," in Proc. of ACM MobiSys, 2019, pp. 313--325.
[45]
D. Li, J. Xu, Z. Yang, Y. Lu, Q. Zhang, and X. Zhang, "Train once, locate anytime for anyone: Adversarial learning based wireless localization," in Proc. of IEEE INFOCOM. IEEE, 2021, pp. 1--10.
[46]
U. Raza, A. Khan, R. Kou, T. Farnham, T. Premalal, A. Stanoev, and W. Thompson, "Dataset: Indoor localization with narrow-band, ultra-wideband, and motion capture systems," in Proceedings of the 2nd Workshop on Data Acquisition to Analysis, 2019, pp. 34--36.
[47]
B.-J. Chen and R. Y. Chang, "Few-shot transfer learning for device-free finger-printing indoor localization," in Proc. of IEEE ICC, 2022, pp. 4631--4636.
[48]
I. O. Korkmaz, T. Özateş, E. Koç, E. Aydın, E. Kor, D. Dilek, M. A. Güngen, I. G. Köse, and Ç. Akman, "Indoor localization with transfer learning," in Proc. of IEEE SIU, 2022, pp. 1--4.
[49]
M. I. AlHajri, R. M. Shubair, and M. Chafii, "Indoor localization under limited measurements: A cross-environment joint semi-supervised and transfer learning approach," in Proc. of IEEE SPAWC Workshop. IEEE, 2021, pp. 266--270.
Index Terms
- Understanding Localization by a Tailored GPT
Recommendations
Indoor Localization Improved by Spatial Context—A Survey
Indoor localization is essential for healthcare, security, augmented reality gaming, and many other location-based services. There is currently a wealth of relevant literature on indoor localization. This article focuses on recent advances in indoor ...
Fundamental Analysis of 3D 6G-Localization Using Reconfigurable Intelligent Surface
Wireless Algorithms, Systems, and ApplicationsAbstractReconfigurable intelligent surface (RIS) is a promising technique in the 6G communication system, which effectively improves the wireless propagation channel. Moreover, the RIS also benefits localization performance since it helps avoid the non-...
Toward attack-resistant localization under infrastructure attacks
Trustworthy location information is important because it is a critical input to a wide variety of location-based applications. However, the localization infrastructure is vulnerable to physical attacks, and consequently, the localization results are ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2024
778 pages
ISBN:9798400705816
DOI:10.1145/3643832
- Chairs:
- Tadashi Okoshi,
- JeongGil Ko,
- Program Chair:
- Robert LiKamWa
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- UGC/GRF
- NSFC Key Program
- Innovation and Technology Fund
- Shenzhen Fundamental Research Program
Conference
MOBISYS '24
Sponsor:
MOBISYS '24: 22nd Annual International Conference on Mobile Systems, Applications and Services
June 3 - 7, 2024
Minato-ku, Tokyo, Japan
Acceptance Rates
Overall Acceptance Rate 274 of 1,679 submissions, 16%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 715Total Downloads
- Downloads (Last 12 months)715
- Downloads (Last 6 weeks)120
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in