[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
research-article

MagDot: Drift-free, Wearable Joint Angle Tracking at Low Cost

Published: 12 January 2024 Publication History

Abstract

Tracking the angular movement of body joints has been a critical enabler for various applications, such as virtual and augmented reality, sports monitoring, and medical rehabilitation. Despite the strong demand for accurate joint tracking, existing techniques, such as cameras, IMUs, and flex sensors, suffer from major limitations that include occlusion, cumulative error, and high cost. These issues collectively undermine the practicality of joint tracking.
We introduce MagDot, a new magnetic-based joint tracking method that enables high-accuracy, drift-free, and wearable joint angle tracking. To overcome the limitations of existing techniques, MagDot employs a novel tracking scheme that compensates for various real-world impacts, achieving high tracking accuracy. We tested MagDot on eight participants with a professional motion capture system, i.e., Qualisys motion capture system with nine Arqus A12 cameras. The results indicate MagDot can accurately track major body joints. For example, MagDot can achieve tracking accuracy of 2.72°, 4.14°, and 4.61° for elbow, knee, and shoulder, respectively. With a power consumption of only 98 mW, MagDot can support one-day usage with a small battery pack.

References

[1]
2018. LIS2MDL magnetometer datasheet - production data. https://www.st.com/resource/en/datasheet/lis2mdl.pdf. (2018).
[2]
2018. RAYTAC.MDBT42Q-512KV2. https://www.raytac.com/product/ins.php?index_id=31. (2018).
[3]
2019. MTi 1-series Datasheet. https://www.xsens.com/hubfs/Downloads/Manuals/MTi-1-series-datasheet.pdf. (2019).
[4]
2020. Xsens Magnetic Calibration Manual. https://www.xsens.com/hubfs/Downloads/Manuals/MT_Magnetic_Calibration_Manual.pdf. (2020).
[5]
2022. User manual of XSens Dot. https://www.xsens.com/hubfs/Downloads/Manuals/Xsens%20DOT%20User%20Manual.pdf. (2022).
[6]
2023a. Datasheet for MLX90393. https://media.melexis.com/-/media/files/documents/datasheets/mlx90393-datasheet-melexis.pdf. (2023).
[7]
2023. KT Tape. https://www.kttape.com/products/kt-tape-original-cotton. (2023).
[8]
2023. Microsoft Azure Kinect. https://azure.microsoft.com/en-us/products/kinect-dk. (2023).
[9]
2023b. MLX90393 Temperature Compensation. https://www.melexis.com/en/documents/documentation/application-notes/application-note-mlx90393-temperature-compensation. (2023).
[10]
2023. NDFEB magnet Technical Data Sheet. https://www.eclipsemagnetics.com/site/assets/files/22177/eclipsemagnetics_ndfeb_datasheet.pdf. (2023).
[11]
2023. Qualisys. https://www.qualisys.com/. (2023).
[12]
2023. Qualisys Arqus A12 camera Tech Specs. https://www.qualisys.com/cameras/arqus/#!#tech-specs. (2023).
[13]
2023. QualiSys Marker Set. https://docs.qualisys.com/getting-started/content/10_how_to_prepare_your_subject/marker_sets.htm. (2023).
[14]
2023. Vicon. https://www.vicon.com/. (2023).
[15]
2023. Visual 3D, Biomechanics Research Tools. https://c-motion.com/. (2023).
[16]
2023. XSens Motion Capture System. https://www.movella.com/products/motion-capture. (2023).
[17]
MD Akhtaruzzaman, Amir Akramin Shafie, and Md Raisuddin Khan. 2016. Gait analysis: Systems, technologies, and importance. Journal of Mechanics in Medicine and Biology 16, 07 (2016), 1630003.
[18]
Robert S Behnke and Jennifer Plant. 2021. Kinetic anatomy. Human Kinetics.
[19]
Antonio Padilha Lanari Bo, Mitsuhiro Hayashibe, and Philippe Poignet. 2011. Joint angle estimation in rehabilitation with inertial sensors and its integration with Kinect. In 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 3479--3483.
[20]
Julien Chapleau, Fanny Canet, Yvan Petit, G-Yves Laflamme, and Dominique M Rouleau. 2011. Validity of goniometric elbow measurements: comparative study with a radiographic method. Clin. Orthop. Relat. Res. 469, 11 (Nov. 2011), 3134--3140.
[21]
Dongyao Chen, Mingke Wang, Chenxi He, Qing Luo, Yasha Iravantchi, Alanson Sample, Kang G Shin, and Xinbing Wang. 2021. MagX: Wearable, untethered hands tracking with passive magnets. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 269--282.
[22]
Ke-Yu Chen, Shwetak N. Patel, and Sean Keller. 2016. Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1504--1514. https://doi.org/10.1145/2858036.2858125
[23]
Xiaowei Chen, Xiao Jiang, Jiawei Fang, Shihui Guo, Juncong Lin, Minghong Liao, Guoliang Luo, and Hongbo Fu. 2023. DisPad: Flexible On-Body Displacement of Fabric Sensors for Robust Joint-Motion Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 1, Article 5 (mar 2023), 27 pages.
[24]
Glen Cooper, Ian Sheret, Louise McMillian, Konstantinos Siliverdis, Ning Sha, Diana Hodgins, Laurence Kenney, and David Howard. 2009. Inertial sensor-based knee flexion/extension angle estimation. Journal of biomechanics 42, 16 (2009), 2678--2685.
[25]
Jianjun Cui, Shih-Ching Yeh, and Si-Huei Lee. 2019. Wearable sensors integrated with virtual reality: a self-guided healthcare system measuring shoulder joint mobility for frozen shoulder. Journal of Healthcare Engineering 2019 (2019).
[26]
Andrea Giovanni Cutti, Andrea Giovanardi, Laura Rocchi, Angelo Davalli, and Rinaldo Sacchetti. 2008. Ambulatory measurement of shoulder and elbow kinematics through inertial and magnetic sensors. Medical & biological engineering & computing 46 (2008), 169--178.
[27]
Mahmoud El-Gohary and James McNames. 2012. Shoulder and elbow joint angle tracking with inertial sensors. IEEE Transactions on Biomedical Engineering 59, 9 (2012), 2635--2641.
[28]
Julien Favre, BM Jolles, Rachid Aissaoui, and K Aminian. 2008. Ambulatory measurement of 3D knee joint angle. Journal of biomechanics 41, 5 (2008), 1029--1035.
[29]
Bo Huang, Mingyu Li, Tao Mei, David McCoul, Shihao Qin, Zhanfeng Zhao, and Jianwen Zhao. 2017. Wearable stretch sensors for motion measurement of the wrist joint based on dielectric elastomers. Sensors 17, 12 (2017), 2708.
[30]
Yinghao Huang, Manuel Kaufmann, Emre Aksan, Michael J Black, Otmar Hilliges, and Gerard Pons-Moll. 2018. Deep inertial poser: Learning to reconstruct human pose from sparse inertial measurements in real time. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1--15.
[31]
Sadaf Hashim Hussain, Boonyapat Limthongkul, and Tatyana R Humphreys. 2013. The biomechanical properties of the skin. Dermatologic Surgery 39, 2 (2013), 193--203.
[32]
Wenjun Jiang, Hongfei Xue, Chenglin Miao, Shiyang Wang, Sen Lin, Chong Tian, Srinivasan Murali, Haochen Hu, Zhi Sun, and Lu Su. 2020. Towards 3D human pose construction using WiFi. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[33]
Wooyoung Kim, Jihoon Song, and Frank C. Park. 2018. Closed-Form Position and Orientation Estimation for a Three-Axis Electromagnetic Tracking System. IEEE Transactions on Industrial Electronics 65, 5 (2018), 4331--4337.
[34]
Naofumi Kitsunezaki, Eijiro Adachi, Takashi Masuda, and Jun-ichi Mizusawa. 2013. KINECT applications for the physical rehabilitation. In 2013 IEEE International Symposium on Medical Measurements and Applications (MeMeA). IEEE, 294--299.
[35]
Miaomiao Liu, Sikai Yang, Wyssanie Chomsin, and Wan Du. 2023. Real-Time Tracking of Smartwatch Orientation and Location by Multitask Learning. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (SenSys '22). Association for Computing Machinery, New York, NY, USA, 780--781.
[36]
Ruibo Liu, Qijia Shao, Siqi Wang, Christina Ru, Devin Balkcom, and Xia Zhou. 2019. Reconstructing human joint motion with computational fabrics. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 1 (2019), 1--26.
[37]
Yilin Liu, Fengyang Jiang, and Mahanth Gowda. 2020. Finger Gesture Tracking for Interactive Applications: A Pilot Study with Sign Languages. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 3, Article 112 (sep 2020), 21 pages.
[38]
Sebastian OH Madgwick, Andrew JL Harrison, and Ravi Vaidyanathan. 2011. Estimation of IMU and MARG orientation using a gradient descent algorithm. In 2011 IEEE international conference on rehabilitation robotics. IEEE, 1--7.
[39]
Robert Mahony, Tarek Hamel, and Jean-Michel Pflimlin. 2008. Nonlinear complementary filters on the special orthogonal group. IEEE Transactions on automatic control 53, 5 (2008), 1203--1218.
[40]
Adam Morawiec. 2003. Orientations and rotations. Springer.
[41]
Jorge J Moré. 2006. The Levenberg-Marquardt algorithm: implementation and theory. In Numerical Analysis: Proceedings of the Biennial Conference Held at Dundee, June 28--July 1, 1977. Springer, 105--116.
[42]
Quentin Mourcou, Anthony Fleury, Bruno Diot, Céline Franco, and Nicolas Vuillerme. 2015. Mobile phone-based joint angle measurement for functional assessment and rehabilitation of proprioception. BioMed research international 2015 (2015).
[43]
Y Nishio, F Tohyama, and N Onishi. 2007. The sensor temperature characteristics of a fluxgate magnetometer by a wide-range temperature test for a Mercury exploration satellite. Measurement Science and Technology 18, 8 (2007), 2721.
[44]
Eshed Ohn-Bar and Mohan M. Trivedi. 2013. Joint Angles Similarities and HOG2 for Action Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
[45]
Hongfeng Pang, Dixiang Chen, Mengchun Pan, Shitu Luo, Qi Zhang, and Feilu Luo. 2012. Nonlinear temperature compensation of fluxgate magnetometers with a least-squares support vector machine. Measurement Science and Technology 23, 2 (2012), 025008.
[46]
Farshid Salemi Parizi, Eric Whitmire, and Shwetak Patel. 2020. AuraRing: Precise Electromagnetic Finger Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 4, Article 150 (sep 2020), 28 pages.
[47]
Timo Pylvänäinen. 2008. Automatic and adaptive calibration of 3D field sensors. Applied Mathematical Modelling 32, 4 (2008), 575--587.
[48]
Feini Qu, Brendan D Stoeckl, Peter M Gebhard, Todd J Hullfish, Josh R Baxter, and Robert L Mauck. 2018. A wearable magnet-based system to assess activity and joint flexion in humans and large animals. Annals of biomedical engineering 46 (2018), 2069--2078.
[49]
Farshid Salemi Parizi, Wolf Kienzle, Eric Whitmire, Aakar Gupta, and Hrvoje Benko. 2021. RotoWrist: Continuous Infrared Wrist Angle Tracking using a Wristband. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. 1--11.
[50]
Thomas Seel, Jorg Raisch, and Thomas Schauer. 2014. IMU-based joint angle measurement for gait analysis. Sensors 14, 4 (2014), 6891--6909.
[51]
Seth J Seidman, Joshua Guag, Brian Beard, and Zane Arp. 2021. Static magnetic field measurements of smart phones and watches and applicability to triggering magnet modes in implantable pacemakers and implantable cardioverter-defibrillators. Heart Rhythm 18, 10 (2021), 1741--1744.
[52]
Arindam Sengupta, Feng Jin, Renyuan Zhang, and Siyang Cao. 2020. mm-Pose: Real-time human skeletal posture estimation using mmWave radars and CNNs. IEEE Sensors Journal 20, 17 (2020), 10032--10044.
[53]
Sheng Shen, Mahanth Gowda, and Romit Roy Choudhury. 2018. Closing the gaps in inertial motion tracking. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 429--444.
[54]
Wolfgang Teufl, Markus Miezal, Bertram Taetz, Michael Fröhlich, and Gabriele Bleser. 2019. Validity of inertial sensor based 3D joint kinematics of static and dynamic sport and physiotherapy specific movements. PloS one 14, 2 (2019), e0213064.
[55]
Jean G Van Bladel. 2007. Electromagnetic fields. Vol. 19. John Wiley & Sons.
[56]
Serge van Sint Jan. 2007. Color atlas of skeletal landmark definitions E-book: guidelines for reproducible manual and virtual palpations. Elsevier Health Sciences.
[57]
Rachel V. Vitali and Noel C. Perkins. 2020. Determining anatomical frames via inertial motion capture: A survey of methods. Journal of Biomechanics 106 (2020), 109832.
[58]
Timo Von Marcard, Bodo Rosenhahn, Michael J Black, and Gerard Pons-Moll. 2017. Sparse inertial poser: Automatic 3d human pose estimation from sparse imus. In Computer graphics forum, Vol. 36. Wiley Online Library, 349--360.
[59]
Fei Wang, Sanping Zhou, Stanislav Panev, Jinsong Han, and Dong Huang. 2019. Person-in-WiFi: Fine-grained person perception using WiFi. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5452--5461.
[60]
Mingke Wang, Qing Luo, Yasha Iravantchi, Xiaomeng Chen, Alanson Sample, Kang G Shin, Xiaohua Tian, Xinbing Wang, and Dongyao Chen. 2022. Automatic calibration of magnetic tracking. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 391--404.
[61]
Kajiro Watanabe and Masaki Hokari. 2006. Kinematical analysis and measurement of sports form. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 36, 3 (2006), 549--557.
[62]
Amanda Watson, Andrew Lyubovsky, Kenneth Koltermann, and Gang Zhou. 2021. Magneto: joint angle analysis using an electromagnet-based sensing method. In Proceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021). 1--14.
[63]
Frank Weichert, Daniel Bachmann, Bartholomäus Rudak, and Denis Fisseler. 2013. Analysis of the Accuracy and Robustness of the Leap Motion Controller. Sensors 13, 5 (2013), 6380--6393.
[64]
Eric Whitmire, Farshid Salemi Parizi, and Shwetak Patel. 2019. Aura: Inside-out Electromagnetic Controller Tracking. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '19). ACM, New York, NY, USA, 300--312.
[65]
Michael W Whittle. 2014. Gait analysis: an introduction. Butterworth-Heinemann.
[66]
Frieder Wittmann, Olivier Lambercy, and Roger Gassert. 2019. Magnetometer-Based Drift Correction During Rest in IMU Arm Motion Tracking. Sensors (Basel, Switzerland) 19 (2019). https://api.semanticscholar.org/CorpusID:83460744
[67]
Chao Yang, Xuyu Wang, and Shiwen Mao. 2020. RFID-pose: Vision-aided three-dimensional human pose estimation with radio-frequency identification. IEEE transactions on reliability 70, 3 (2020), 1218--1231.
[68]
Xinyu Yi, Yuxiao Zhou, and Feng Xu. 2021. Transpose: Real-time 3d human translation and pose estimation with six inertial sensors. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1--13.
[69]
Mingmin Zhao, Tianhong Li, Mohammad Abu Alsheikh, Yonglong Tian, Hang Zhao, Antonio Torralba, and Dina Katabi. 2018. Through-wall human pose estimation using radio signals. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7356--7365.
[70]
Hao Zhou, Taiting Lu, Yilin Liu, Shijia Zhang, and Mahanth Gowda. 2022. Learning on the Rings: Self-Supervised 3D Finger Motion Tracking Using Wearable Sensors. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 90 (jul 2022), 31 pages.
[71]
Pengfei Zhou, Mo Li, and Guobin Shen. 2014. Use it free: Instantly knowing your phone attitude. In Proceedings of the 20th annual international conference on Mobile computing and networking. 605--616.

Cited By

View all
  • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
  • (2024)Generating Multivariate Synthetic Time Series Data for Absent Sensors from Correlated SourcesProceedings of the 2nd International Workshop on Networked AI Systems10.1145/3662004.3663553(19-24)Online publication date: 3-Jun-2024
  • (2024)Push the Limit of Highly Accurate Ranging on Commercial UWB DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596028:2(1-27)Online publication date: 15-May-2024
  • Show More Cited By

Index Terms

  1. MagDot: Drift-free, Wearable Joint Angle Tracking at Low Cost

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 7, Issue 4
    December 2023
    1613 pages
    EISSN:2474-9567
    DOI:10.1145/3640795
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 12 January 2024
    Published in IMWUT Volume 7, Issue 4

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Joint Angle
    2. Magnetic Sensing
    3. Motion Capture

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)353
    • Downloads (Last 6 weeks)32
    Reflects downloads up to 12 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
    • (2024)Generating Multivariate Synthetic Time Series Data for Absent Sensors from Correlated SourcesProceedings of the 2nd International Workshop on Networked AI Systems10.1145/3662004.3663553(19-24)Online publication date: 3-Jun-2024
    • (2024)Push the Limit of Highly Accurate Ranging on Commercial UWB DevicesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596028:2(1-27)Online publication date: 15-May-2024
    • (2024)RFSpy: Eavesdropping on Online Conversations with Out-of-Vocabulary Words by Sensing Metal Coil Vibration of Headsets Leveraging RFIDProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661887(169-182)Online publication date: 3-Jun-2024
    • (2024)MSense: Boosting Wireless Sensing Capability Under Motion InterferenceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649350(108-123)Online publication date: 29-May-2024
    • (2023)Self-adaptive motion tracking against on-body displacement of flexible sensorsProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3669501(77277-77289)Online publication date: 10-Dec-2023
    • (2023)MESEN: Exploit Multimodal Data to Design Unimodal Human Activity Recognition with Few LabelsProceedings of the 21st ACM Conference on Embedded Networked Sensor Systems10.1145/3625687.3625782(1-14)Online publication date: 12-Nov-2023

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media