More Web Proxy on the site http://driver.im/

research-article

HIPPO: Pervasive Hand-Grip Estimation from Everyday Interactions

Authors:

Mohan Liyanage,

Abdul-Rasheed Ottun,

Agustin Zuniga,

Huber FloresAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 6, Issue 4

Article No.: 209, Pages 1 - 30

https://doi.org/10.1145/3570344

Published: 11 January 2023 Publication History

Abstract

Hand-grip strength is widely used to estimate muscle strength and it serves as a general indicator of the overall health of a person, particularly in aging adults. Hand-grip strength is typically estimated using dynamometers or specialized force resistant pressure sensors embedded onto objects. Both of these solutions require the user to interact with a dedicated measurement device which unnecessarily restricts the contexts where estimates are acquired. We contribute HIPPO, a novel non-intrusive and opportunistic method for estimating hand-grip strength from everyday interactions with objects. HIPPO re-purposes light sensors available in wearables (e.g., rings or gloves) to capture changes in light reflectivity when people interact with objects. This allows HIPPO to non-intrusively piggyback everyday interactions for health information without affecting the user's everyday routines. We present two prototypes integrating HIPPO, an early smart glove proof-of-concept, and a further optimized solution that uses sensors integrated onto a ring. We validate HIPPO through extensive experiments and compare HIPPO against three baselines, including a clinical dynamometer. Our results show that HIPPO operates robustly across a wide range of everyday objects, and participants. The force strength estimates correlate with estimates produced by pressure-based devices, and can also determine the correct hand grip strength category with up to 86% accuracy. Our findings also suggest that users prefer our approach to existing solutions as HIPPO blends the estimation with everyday interactions.

References

[1]

Diane E Adamo, Tara Anderson, Mahtab Koochaki, and Nora E Fritz. 2020. Declines in grip strength may indicate early changes in cognition in healthy middle-aged adults. PloS One 15, 4 (2020), e0232021. https://doi.org/10.1371/journal.pone.0232021

[2]

Williams A. Andrews and Richard W Bohannon. 2000. Distribution of muscle strength impairments following stroke. Clinical Rehabilitation 14, 1 (2000), 79--87. https://doi.org/10.1191/026921500673950113

[3]

Pablo Arias, Christopher Kelley, Janelle Mason, Kelvin Bryant, and Kaushik Roy. 2018. Classification of user movement data. In Proceedings of the International Conference on Digital Signal Processing. ACM, Tokyo, Japan, 156--160. https://doi.org/10.1145/3193025.3193036

Digital Library

[4]

Bert Arnrich, Oscar Mayora, Jakob Bardram, and Gerhard Tröster. 2010. Pervasive healthcare. Methods of Information in Medicine 49, 01 (2010), 67--73. https://doi.org/10.3414/ME09-02-0044

[5]

Johannes Beller, Alexander Miething, Enrique Regidor, Lourdes Lostao, Jelena Epping, and Siegfried Geyer. 2019. Trends in grip strength: Age, period, and cohort effects on grip strength in older adults from Germany, Sweden, and Spain. SSM-Population Health 9 (2019), 100456. https://doi.org/10.1016/j.ssmph.2019.100456

[6]

Richard W Bohannon. 2019. Grip strength: An indispensable biomarker for older adults. Clinical Interventions in Aging 14 (2019), 1681. https://doi.org/10.2147%2FCIA.S194543

[7]

Richard W Bohannon and Karen L Schaubert. 2005. Test-retest reliability of grip-strength measures obtained over a 12-week interval from community-dwelling elders. Journal of Hand Therapy 18, 4 (2005), 426--428. https://doi.org/10.1197/j.jht.2005.07.003

[8]

Carlos A Celis-Morales, Paul Welsh, Donald M. Lyall, Lewis Steell, Fanny Petermann, Jana Anderson, Stamatina Iliodromiti, Anne Sillars, Nicholas Graham, Daniel F. Mackay, Jill P. Pell, Jason M. R. Gill, Naveed Sattar, and Stuart R. Gray. 2018. Associations of grip strength with cardiovascular, respiratory, and cancer outcomes and all cause mortality: Prospective cohort study of half a million UK Biobank participants. theBmj 361 (2018), 1651--1661. https://doi.org/10.1136/bmj.k1651

[9]

Farooq Dar, Hilary Emenike, Zhigang Yin, Mohan Liyanage, Rajesh Sharma, Agustin Zuniga, Mohammad A Hoque, Marko Radeta, Petteri Nurmi, and Huber Flores. 2022. The MIDAS touch: Thermal dissipation resulting from everyday interactions as a sensing modality. Pervasive and Mobile Computing 84 (2022), 1--18.

Digital Library

[10]

Michel de Mathelin, Florent Nageotte, Philippe Zanne, and Birgitta Dresp-Langley. 2019. Sensors for expert grip force profiling: towards benchmarking manual control of a robotic device for surgical tool movements. Sensors 19, 20 (2019), 4575. https://doi.org/10.3390/S19204575

[11]

Walaa M El-Sais and Walaa S Mohammad. 2014. Influence of different testing postures on hand grip strength. European Scientific Journal 10, 36 (2014), 290--301. https://eujournal.org/index.php/esj/article/view/4904

[12]

Hilary Emenike, Farooq Dar, Mohan Liyanage, Rajesh Sharma, Agustin Zuniga, Mohammad A. Hoque, Marko Radeta, Petteri Nurmi, and Huber Flores. 2021. Characterizing everyday objects using human touch: Thermal dissipation as a sensing modality. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom'21). IEEE, Kassel, Germany, 1--8. https://doi.org/10.1109/PERCOM50583.2021.9439120

[13]

Francisco Espinoza, Pierre Le Blay, Denis Coulon, Sylvain Lieu, Janet Munro, Christian Jorgensen, and Yves-Marie Pers. 2016. Handgrip strength measured by a dynamometer connected to a smartphone: A new applied health technology solution for the self-assessment of rheumatoid arthritis disease activity. Rheumatology 55, 5 (2016), 897--901. https://doi.org/10.1093/rheumatology/kew006

[14]

Junjun Fan, Xiangmin Fan, Feng Tian, Yang Li, Zitao Liu, Wei Sun, and Hongan Wang. 2018. What is that in your hand? Recognizing grasped objects via forearm electromyography sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4 (2018), 1--24. https://doi.org/10.1145/3287039

Digital Library

[15]

Huber Flores, Agustin Zuniga, Naser Hossein Motlagh, Mohan Liyanage, Monica Passananti, Sasu Tarkoma, Moustafa Youssef, and Petteri Nurmi. 2020. Penguin: Aquatic plastic pollution sensing using AUVs. In Proceedings of the ACM Workshop on Micro Aerial Vehicle Networks, Systems, and Applications (DroNet'20). ACM, ACM New York, NY, USA, 1--6. https://doi.org/10.1145/3396864.3399704

Digital Library

[16]

Nizan Friedman, Vicky Chan, Andrea N Reinkensmeyer, Ariel Beroukhim, Gregory J Zambrano, Mark Bachman, and David J Reinkensmeyer. 2014. Retraining and assessing hand movement after stroke using the MusicGlove: Comparison with conventional hand therapy and isometric grip training. Journal of NeuroEngineering and Rehabilitation 11, 1 (2014), 1--14. https://doi.org/10.1186/1743-0003-11-76

[17]

Mayank Goel, Jacob Wobbrock, and Shwetak Patel. 2012. GripSense: Using built-in sensors to detect hand posture and pressure on commodity mobile phones. In ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 545--554. https://doi.org/10.1145/2380116.2380184

Digital Library

[18]

Weixi Gu, Yuxun Zhou, Zimu Zhou, Xi Liu, Han Zou, Pei Zhang, Costas J Spanos, and Lin Zhang. 2017. SugarMate: Non-intrusive blood glucose monitoring with smartphones. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--27. https://doi.org/10.1145/3130919

Digital Library

[19]

RS Guerra, I Fonseca, F Pichel, MT Restivo, and TF Amaral. 2014. Hand length as an alternative measurement of height. European Journal of Clinical Nutrition 68, 2 (2014), 229--233. https://doi.org/10.1038/ejcn.2013.220

[20]

Jing Han, Chloë Brown, Jagmohan Chauhan, Andreas Grammenos, Apinan Hasthanasombat, Dimitris Spathis, Tong Xia, Pietro Cicuta, and Cecilia Mascolo. 2021. Exploring automatic COVID-19 diagnosis via voice and symptoms from crowdsourced data. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'21). IEEE, Toronto, ON, Canada, 8328--8332. https://doi.org/10.1109/ICASSP39728.2021.9414576

[21]

Jing Han, Tong Xia, Dimitris Spathis, Erika Bondareva, Chloë Brown, Jagmohan Chauhan, Ting Dang, Andreas Grammenos, Apinan Hasthanasombat, Floto Floto, Andres, Cicuta Piero, and Mascolo Cecilia. 2021. Sounds of COVID-19: Exploring realistic performance of audio-based digital testing. npj Digital Medicine 5 (2021), 1--9. https://doi.org/10.1038/s41746-021-00553-x

[22]

Katrin Hänsel, Akram Alomainy, and Hamed Haddadi. 2016. Large scale mood and stress self-assessments on a smartwatch. In ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 1180--1184. https://doi.org/10.1145/2968219.2968305

Digital Library

[23]

Christian Holz and Edward J Wang. 2017. Glabella: Continuously sensing blood pressure behavior using an unobtrusive wearable device. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--23. https://doi.org/10.1145/3132024

Digital Library

[24]

James M Hunter, Lawrence H Schneider, Evelyn J Mackin, and Anne D Callahan. 1990. Rehabilitation of the hand: Surgery and therapy. In Rehabilitation of the hand: Surgery and therapy. St. Louis: Mosby, USA, 1258--1258.

[25]

Sinh Huynh, Rajesh Krishna Balan, JeongGil Ko, and Youngki Lee. 2019. VitaMon: Measuring heart rate variability using smartphone front camera. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys '19). ACM, New York, NY, United States, 1--14. https://doi.org/10.1145/3356250.3360036

Digital Library

[26]

Kevin Jiokeng, Gentian Jakllari, and André-Luc Beylot. 2021. HandRate: Heart rate monitoring while simply holding a smartphone. In Proceedings of IEEE International Conference on Pervasive Computing and Communications (PerCom'21). IEEE, Kassel, Germany, 1--11. https://doi.org/10.1109/PERCOM50583.2021.9439134

[27]

Kee-Eung Kim, Wook Chang, Sung-Jung Cho, Junghyun Shim, Hyunjeong Lee, Joonah Park, Youngbeom Lee, and Sangryoung Kim. 2006. Hand grip pattern recognition for mobile user interfaces. In Proceedings of the ACM Conference on Innovative Applications of Artificial Intelligence (IAAI'06). ACM, Boston Massachusetts, USA, 1789--1794. https://doi.org/10.5555/1597122.1597138

Digital Library

[28]

Yoojung Kim, Hee-Tae Jung, Joonwoo Park, Yangsoo Kim, Nathan Ramasarma, Paolo Bonato, Eun Kyoung Choe, and Sunghoon Ivan Lee. 2019. Towards the design of a ring sensor-based mHealth system to achieve optimal motor function in stroke survivors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1--26. https://doi.org/10.1145/3369817

Digital Library

[29]

Hiroshi Kinoshita, Satoru Kawai, and Komei Ikuta. 1995. Contributions and co-ordination of individual fingers in multiple finger prehension. Ergonomics 38, 6 (1995), 1212--1230. https://doi.org/10.1080/00140139508925183

[30]

Setor K Kunutsor, Ari Voutilainen, and Jari A Laukkanen. 2020. Handgrip strength improves prediction of type 2 diabetes: A prospective cohort study. Annals of Medicine 52, 8 (2020), 471--478. https://doi.org/10.1080/07853890.2020.1815078

[31]

Elina Kuosmanen, Valerii Kan, Aku Visuri, Simo Hosio, and Denzil Ferreira. 2020. Let's Draw: Detecting and measuring parkinson's disease on smartphones. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'20). ACM, Honolulu, HI, USA, 1--9. https://doi.org/10.1145/3313831.3376864

Digital Library

[32]

Yongbo Liang, Mohamed Elgendi, Zhencheng Chen, and Rabab Ward. 2018. An optimal filter for short photoplethysmogram signals. Scientific Data 5, 1 (2018), 1--12. https://doi.org/10.1038/sdata.2018.76

[33]

Rongrong Liu, Florent Nageotte, Philippe Zanne, Michel de Mathelin, and Birgitta Dresp-Langley. 2021. Wearable sensor technology for individual grip force profiling. Automation, Robotics & Communications for Industry 4.0 1 (2021), 12--13.

[34]

Niko Mäkitalo, Daniel Flores-Martin, Huber Flores, Eemil Lagerspetz, Francois Christophe, Petri Ihantola, Masiar Babazadeh, Pan Hui, Juan Manuel Murillo, Sasu Tarkoma, and Tommi Mikkonen. 2020. Human data model: Improving programmability of health and well-being data for enhanced perception and interaction. ACM Transactions on Computing for Healthcare 1, 4 (2020), 1--39. https://doi.org/10.1145/3402524

Digital Library

[35]

Nicola M Massy-Westropp, Tiffany K Gill, Anne W Taylor, Richard W Bohannon, and Catherine L Hill. 2011. Hand grip strength: Age and gender stratified normative data in a population-based study. BMC Research Notes 4, 1(2011), 1--5. https://doi.org/10.1186/1756-0500-4-127

[36]

Ryan McGrath, Nathaniel Johnson, Lukus Klawitter, Sean Mahoney, Kara Trautman, Caroline Carlson, Ella Rockstad, and Kyle J Hackney. 2020. What are the association patterns between handgrip strength and adverse health conditions? A topical review. SAGE Open Medicine 8 (2020), 1--12. https://doi.org/10.1177/2050312120910358

[37]

Ryan McGrath, Sheria G Robinson-Lane, Summer Cook, Brian C Clark, Stephen Herrmann, Melissa Lunsman O'Connor, and Kyle J Hackney. 2019. Handgrip strength is associated with poorer cognitive functioning in aging Americans. Journal of Alzheimer's Disease 70, 4(2019), 1187--1196. https://doi.org/10.3233/JAD-190042

[38]

Rita Pavasini, Matteo Serenelli, Carlos A Celis-Morales, Stuart R Gray, Kazuhiro P Izawa, Satoshi Watanabe, Eloisa Colin-Ramirez, Lilia Castillo-Martínez, Yasuhiro Izumiya, Shinsuke Hanatani, Yoshiro Onoue, Kenichi Tsujita, Peter S Macdonald, Sunita R Jha, Véronique L Roger, Sheila M Manemann, Juan Sanchis, Vicente Ruiz, Giulia Bugani, Elisabetta Tonet, Roberto Ferrari, Stefano Volpato, and Gianluca Campo. 2019. Grip strength predicts cardiac adverse events in patients with cardiac disorders: An individual patient pooled meta-analysis. Heart 105, 11 (2019), 834--841. https://doi.org/10.1136/heartjnl-2018-313816

[39]

Philip Quinn, Seungyon Claire Lee, Melissa Barnhart, and Shumin Zhai. 2019. Active edge: Designing squeeze gestures for the google pixel 2. In Proceedings of the Conference on Human Factors in Computing Systems (CHI'19). ACM, Glasgow, Scotland UK, 1--13. https://doi.org/10.1145/3290605.3300504

Digital Library

[40]

Robinson Ramírez-Vélez, Jorge Enrique Correa-Bautista, Antonio García-Hermoso, Carlos Alberto Cano, and Mikel Izquierdo. 2019. Reference values for handgrip strength and their association with intrinsic capacity domains among older adults. Journal of Cachexia, Sarcopenia and Muscle 10, 2 (2019), 278--286. https://doi.org/10.1002/jcsm.12373

[41]

Philippe Renevey, Ricard Delgado-Gonzalo, Alia Lemkaddem, Martin Proença, Mathieu Lemay, Josep Solà, Adrian Tarniceriu, and Mattia Bertschi. 2017. Optical wrist-worn device for sleep monitoring. In EMBEC & NBC 2017. Springer, Tampere, Finland, 615--618. https://doi.org/10.1007/978-981-10-5122-7_154

[42]

Helen C Roberts, Hayley J Denison, Helen J Martin, Harnish P Patel, Holly Syddall, Cyrus Cooper, and Avan Aihie Sayer. 2011. A review of the measurement of grip strength in clinical and epidemiological studies: Towards a standardised approach. Age and Ageing 40, 4 (2011), 423--429. https://doi.org/10.1093/ageing/afr051

[43]

Lisa Schrader, Agustín Vargas Toro, Sebastian Konietzny, Stefan Rüping, Barbara Schäpers, Martina Steinböck, Carmen Krewer, Friedemann Müller, Jörg Güttler, and Thomas Bock. 2020. Advanced sensing and human activity recognition in early intervention and rehabilitation of elderly people. Journal of Population Ageing 13 (2020), 139--165. https://doi.org/10.1007/s12062-020-09260-z

[44]

Adwait Sharma, Michael A Hedderich, Divyanshu Bhardwaj, Bruno Fruchard, Jess McIntosh, Aditya Shekhar Nittala, Dietrich Klakow, Daniel Ashbrook, and Jürgen Steimle. 2021. SoloFinger: Robust microgestures while grasping everyday objects. In Proceedings of Conference on Human Factors in Computing Systems (CHI'21). ACM, Yokohama, Japan, 1--15. https://doi.org/10.1145/3411764.3445197

Digital Library

[45]

Sari Stenholm, Janne Sallinen, Annemarie Koster, Taina Rantanen, Päivi Sainio, Markku Heliövaara, and Seppo Koskinen. 2011. Association between obesity history and hand grip strength in older adults---exploring the roles of inflammation and insulin resistance as mediating factors. Journals of Gerontology Series A: Biomedical Sciences and Medical Sciences 66, 3 (2011), 341--348. https://doi.org/10.1093/gerona/glq226

[46]

Jason Tallis, Rob S James, and Frank Seebacher. 2018. The effects of obesity on skeletal muscle contractile function. Journal of Experimental Biology 221, 13 (2018), 1--14. https://doi.org/10.1242/jeb.163840

[47]

D Trosclair, D Bellar, LW Judge, J Smith, N Mazerat, and A Brignac. 2011. Hand-grip strength as a predictor of muscular strength and endurance. The Journal of Strength & Conditioning Research 25 (2011), S99. https://doi.org/10.1097/01.JSC.0000395736.42557.bc

[48]

Peter M Visscher. 2008. Sizing up human height variation. Nature genetics 40, 5 (2008), 489--490. https://doi.org/10.1038/ng0508-489

[49]

Shibo Zhang, Yuqi Zhao, Dzung Tri Nguyen, Runsheng Xu, Sougata Sen, Josiah Hester, and Nabil Alshurafa. 2020. NeckSense: A multi-sensor necklace for detecting eating activities in free-living conditions. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--26. https://doi.org/10.1145/3397313

Digital Library

[50]

Paula Zuccotti. 2015. Every thing we touch: A 24-hour inventory of our lives. Penguin UK, UK.

[51]

Agustin Zuniga, Huber Flores, and Petteri Nurmi. 2021. Ripe or rotten? Low-cost produce quality estimation using reflective green light sensing. IEEE Pervasive Computing 20, 3 (2021), 60--67. https://doi.org/10.1109/MPRV.2021.3074474

Cited By

Araujo De Aguiar CHarry OStone Shi SChan Ying M(2024)Grasp the Future: Supporting Grip Strength Assistance with GripAidProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652066(169-176)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3652066

Index Terms

HIPPO: Pervasive Hand-Grip Estimation from Everyday Interactions
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing design and evaluation methods

Recommendations

Hedgehog: Detecting Drink Spiking on Wearables
HotMobile '23: Proceedings of the 24th International Workshop on Mobile Computing Systems and Applications

People increasingly carry wearables and the capabilities of these devices have reached a point where it is increasingly possible to harness the devices to support everyday interactions. We contribute a new use of wearables by demonstrating how they can ...
Demo Abstract: A Smart Ring Monitoring Your Health using Hand-grip Strength
SenSys '23: Proceedings of the 21st ACM Conference on Embedded Networked Sensor Systems

Hand-grip strength is a widely recognized indicator of muscle strength and overall health of individuals, particularly among older adults. Hand-grip strength measurements are typically obtained using dynamometers or specifically tailored devices, ...
Monitoring meaningful activities using small low-cost devices in a smart home

A challenge associated with an ageing population is increased demand on health and social care, creating a greater need to enable persons to live independently in their own homes. Ambient assistant living technology aims to address this by monitoring ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 6, Issue 4

December 2022

1534 pages

EISSN:2474-9567

DOI:10.1145/3580286

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 January 2023

Published in IMWUT Volume 6, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Estonian Center of Excellence in ICT Research
European Social Fund
Academy of Finland project
Nokia Foundation grant

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
315
Total Downloads

Downloads (Last 12 months)114
Downloads (Last 6 weeks)10

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Araujo De Aguiar CHarry OStone Shi SChan Ying M(2024)Grasp the Future: Supporting Grip Strength Assistance with GripAidProceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3652037.3652066(169-176)Online publication date: 26-Jun-2024
https://dl.acm.org/doi/10.1145/3652037.3652066

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents