[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3453892.3453996acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

9PM: A Novel Interactive 9-Peg Board for Cognitive and Physical Assessment

Published: 29 June 2021 Publication History

Abstract

Cognitive assessments are a crucial part of rehabilitation in persons with a neurological disorder and vocational rehabilitation, where people need to be trained to improve their cognitive abilities. While human action involves using several cognitive skills and physical skills, most assessment systems focus on detecting or assessing either the cognitive ability or just physical ability. There is a need for a system that bridges the gap between real-world activity, which involves physical activity and cognition, and clinical tests that are tailored for a specific use. To address this need, we propose a novel interactive 9-Hole Pegboard called the 9-Peg Move (9PM) capable of performing both cognitive and physical assessments in the same system. The system incorporates wearable sensors to collect data for objective evaluation. Preliminary machine learning results indicate that the data collected using our system can reliably recognize cognitive factors like perceived mental effort, perceived task difficulty, and perceived interest in a task. These results are the first step toward building an automated immersive assessment system.

References

[1]
Maher Abujelala 2019. THINK2ACT: USING MULTIMODAL DATA TO ASSESS HUMAN COGNITIVE AND PHYSICAL PERFORMANCE. Ph.D. Dissertation.
[2]
Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra, and Jorge Luis Reyes-Ortiz. 2013. A public domain dataset for human activity recognition using smartphones. In Esann, Vol. 3. 3.
[3]
Ashwin Ramesh Babu, Akilesh Rajavenkatanarayanan, James Robert Brady, and Fillia Makedon. 2018. Multimodal approach for cognitive task performance prediction from body postures, facial expressions and EEG signal. In Proceedings of the Workshop on Modeling Cognitive Processes from Multimodal Data. 1–7.
[4]
Francisco Barceló, Juan M Muñoz-Céspedes, Miguel A Pozo, and Francisco J Rubia. 2000. Attentional set shifting modulates the target P3b response in the Wisconsin card sorting test. Neuropsychologia 38, 10 (2000), 1342–1355.
[5]
Patricia J Bauer, Sureyya S Dikmen, Robert K Heaton, Dan Mungas, Jerry Slotkin, and Jennifer L Beaumont. 2013. III. NIH Toolbox Cognition Battery (CB): measuring episodic memory. Monographs of the Society for Research in Child Development 78, 4(2013), 34–48.
[6]
Biosignalsplux [n.d.]. Biosignalsplux | wearable body sensing platform - Explorer. https://www.biosignalsplux.com/en/explorer
[7]
Sansanee Boonnithi and Sukanya Phongsuphap. 2011. Comparison of heart rate variability measures for mental stress detection. In 2011 Computing in Cardiology. IEEE, 85–88.
[8]
Noelle E Carlozzi, Jennifer L Beaumont, David S Tulsky, and Richard C Gershon. 2015. The NIH toolbox pattern comparison processing speed test: normative data. Archives of Clinical Neuropsychology 30, 5 (2015), 359–368.
[9]
John DeLuca, Helen M Genova, Frank G Hillary, and Glenn Wylie. 2008. Neural correlates of cognitive fatigue in multiple sclerosis using functional MRI. Journal of the neurological sciences 270, 1-2 (2008), 28–39.
[10]
Sureyya S Dikmen, Patricia J Bauer, Sandra Weintraub, Dan Mungas, Jerry Slotkin, Jennifer L Beaumont, Richard Gershon, Nancy R Temkin, and Robert K Heaton. 2014. Measuring episodic memory across the lifespan: NIH toolbox picture sequence memory test. Journal of the International Neuropsychological Society 20, 6(2014), 611–619.
[11]
Gammon M Earhart, Jim T Cavanaugh, Terry Ellis, Matt P Ford, K Bo Foreman, and Lee Dibble. 2011. The 9-hole PEG test of upper extremity function: average values, test-retest reliability, and factors contributing to performance in people with Parkinson disease. Journal of Neurologic Physical Therapy 35, 4 (2011), 157–163.
[12]
Peter Feys, Ilse Lamers, Gordon Francis, Ralph Benedict, Glenn Phillips, Nicholas LaRocca, Lynn D Hudson, Richard Rudick, and Multiple Sclerosis Outcome Assessments Consortium. 2017. The Nine-Hole Peg Test as a manual dexterity performance measure for multiple sclerosis. Multiple Sclerosis Journal 23, 5 (2017), 711–720.
[13]
James M Fisher, Nils Y Hammerla, Lynn Rochester, Peter Andras, and Richard W Walker. 2016. Body-worn sensors in Parkinson’s disease: Evaluating their acceptability to patients. Telemedicine and e-Health 22, 1 (2016), 63–69.
[14]
Maurizio Garbarino, Matteo Lai, Dan Bender, Rosalind W Picard, and Simone Tognetti. 2014. Empatica E3—A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In 2014 4th International Conference on Wireless Mobile Communication and Healthcare-Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH). IEEE, 39–42.
[15]
Giorgos Giannakakis, Dimitris Grigoriadis, Katerina Giannakaki, Olympia Simantiraki, Alexandros Roniotis, and Manolis Tsiknakis. 2019. Review on psychological stress detection using biosignals. IEEE Transactions on Affective Computing(2019).
[16]
Theodoros Giannakopoulos. 2015. pyaudioanalysis: An open-source python library for audio signal analysis. PloS one 10, 12 (2015), e0144610.
[17]
David A Grant and Esta Berg. 1948. A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem.Journal of experimental psychology 38, 4 (1948), 404.
[18]
Ryan Hays, Philip Henson, Hannah Wisniewski, Victoria Hendel, Aditya Vaidyam, and John Torous. 2019. Assessing cognition outside of the clinic: smartphones and sensors for cognitive assessment across diverse psychiatric disorders. Psychiatric Clinics 42, 4 (2019), 611–625.
[19]
Varun Kanal, James Brady, Harish Nambiappan, Maria Kyrarini, Glenn Wylie, and Fillia Makedon. 2020. Towards a serious game based human-robot framework for fatigue assessment. In Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 1–6.
[20]
Virgil Mathiowetz, Gloria Volland, Nancy Kashman, and Karen Weber. 1985. Adult norms for the Box and Block Test of manual dexterity. American Journal of Occupational Therapy 39, 6 (1985), 386–391.
[21]
MetaMotionR - MbientLab [n.d.]. MetaMotionR - MbientLab. https://mbientlab.com/metamotionr/
[22]
OpenBCI [n.d.]. Ultracortex Mark IV | OpenBCI Documentation. http://docs.openbci.com/Headware/01-Ultracortex-Mark-IV
[23]
Michalis Papakostas, Akilesh Rajavenkatanarayanan, and Fillia Makedon. 2019. CogBeacon: A Multi-Modal Dataset and Data-Collection Platform for Modeling Cognitive Fatigue. Technologies 7, 2 (2019), 46.
[24]
Janet L Poole, Patricia A Burtner, Theresa A Torres, Cheryl Kirk McMullen, Amy Markham, Michelle Lee Marcum, Jennifer Bradley Anderson, and Clifford Qualls. 2005. Measuring dexterity in children using the Nine-hole Peg Test. Journal of Hand Therapy 18, 3 (2005), 348–351.
[25]
Sen Qiu, Zhelong Wang, Hongyu Zhao, Long Liu, and Yongmei Jiang. 2018. Using body-worn sensors for preliminary rehabilitation assessment in stroke victims with gait impairment. IEEE Access 6(2018), 31249–31258.
[26]
Akilesh Rajavenkatanarayanan, Varun Kanal, Konstantinos Tsiakas, James Brady, Diane Calderon, Glenn Wylie, and Fillia Makedon. 2019. Towards a robot-based multimodal framework to assess the impact of fatigue on user behavior and performance: a pilot study. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 493–498.
[27]
A. Rajavenkatanarayanan, H. R. Nambiappan, M. Kyrarini, and F. Makedon. 2020. Towards a Real-Time Cognitive Load Assessment System for Industrial Human-Robot Cooperation. In 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). 698–705. https://doi.org/10.1109/RO-MAN47096.2020.9223531
[28]
Yutaka Sasaki. 2007. The truth oh the F–measure. Manchester: School of Computer Science, University of Manchester (2007).
[29]
Federica Scarpina and Sofia Tagini. 2017. The Stroop Color and Word Test. Frontiers in Psychology 8 (2017), 557. https://doi.org/10.3389/fpsyg.2017.00557
[30]
scikit [n.d.]. Scikit-Learn: RandomizedSearchCV. https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.RandomizedSearchCV.html
[31]
Fred Shaffer and JP Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in public health 5 (2017), 258.
[32]
J Ridley Stroop. 1935. Studies of interference in serial verbal reactions.Journal of experimental psychology 18, 6 (1935), 643.
[33]
Jeanette Taylor. 2007. Heritability of Wisconsin Card Sorting Test (WCST) and Stroop Color-Word Test performance in normal individuals: implications for the search for endophenotypes. Twin Research and Human Genetics 10, 6 (2007), 829–834.
[34]
Sara Taylor, Natasha Jaques, Weixuan Chen, Szymon Fedor, Akane Sano, and Rosalind Picard. 2015. Automatic identification of artifacts in electrodermal activity data. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 1934–1937.
[35]
Konstantinos Tsiakas, Maher Abujelala, and Fillia Makedon. 2018. Task engagement as personalization feedback for socially-assistive robots and cognitive training. Technologies 6, 2 (2018), 49.
[36]
David S Tulsky, Noelle Carlozzi, Nancy D Chiaravalloti, Jennifer L Beaumont, Pamela A Kisala, Dan Mungas, Kevin Conway, and Richard Gershon. 2014. NIH Toolbox Cognition Battery (NIHTB-CB): The list sorting test to measure working memory. Journal of the International Neuropsychological Society: JINS 20, 6(2014), 599.
[37]
Simone Varrasi, Santo Di Nuovo, Daniela Conti, and Alessandro Di Nuovo. 2018. A social robot for cognitive assessment. In Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. 269–270.
[38]
Robert R Whelan. 2007. Neuroimaging of cognitive load in instructional multimedia. Educational Research Review 2, 1 (2007), 1–12.

Cited By

View all
  • (2023)Toward an EEG-Based System for Monitoring Cognitive Load in Neurosurgeons2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE58569.2023.10405711(456-461)Online publication date: 25-Oct-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
PETRA '21: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference
June 2021
593 pages
ISBN:9781450387927
DOI:10.1145/3453892
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Nine Hole Peg Test
  2. Physical assessment
  3. cognitive assessment
  4. physiological sensing
  5. wearable sensors

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

PETRA '21

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)2
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Toward an EEG-Based System for Monitoring Cognitive Load in Neurosurgeons2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE58569.2023.10405711(456-461)Online publication date: 25-Oct-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media