Abstract
Daily monitoring of Parkinson’s disease is important since clinical assessments can only provide a brief and limited view of a patient’s condition. However, traditional approaches rely heavily on patients’ self-reports or diaries, which are subjective and often lack of necessary details. In this work, we instrument a handle that can be attached to cutlery with inertial sensors to collect motion data unobtrusively. By analyzing the data of patients and normal people collected in the clinic, we demonstrated that our machine learning based model can not only distinguish between patients and normal people, but also identify the disease levels in a fine-grained manner. To further understand how the self-tracking data is used in clinic, we conducted a semi-structured interview with several clinicians. Through the interpretation from the perspective of both physicians and patients, we found that our handle can help the physicians better understand disease progression and promote patients’ engagement in tackling the disease.
Similar content being viewed by others
References
Abhinaya, B., Charanya, D., Thanaraj, K.P.: Feature extraction and selection of a combination of entropy features for real-time epilepsy detection. Int. J. Eng. Comput. Sci. 5(4), 16073–16078 (2016)
Agostino, R., Berardelli, A., Currà, A., Accornero, N., Manfredi, M.: Clinical impairment of sequential finger movements in Parkinson’s disease. Mov. Disord. 13(3), 418–421 (1998)
Bhavana, C., Gopal, J., Raghavendra, P., Vanitha, K., Talasila, V.: Techniques of measurement for Parkinson’s tremor highlighting advantages of embedded imu over emg. In: Recent trends in information technology (ICRTIT), 2016 international conference on, pp. 1–5. IEEE (2016)
Bonato, P., Sherrill, D.M., Standaert, D.G., Salles, S.S., Akay, M.: Data mining techniques to detect motor fluctuations in Parkinson’s disease. In: Engineering in Medicine and Biology Society, 2004. IEMBS’04. 26th Annual International Conference of the IEEE, vol. 2, pp. 4766–4769. IEEE (2004)
Brown, R.G., MacCarthy, B., Jahanshahi, M., Marsden, C.D.: Accuracy of self-reported disability in patients with Parkinsonism. Arch. Neurol. 46(9), 955–959 (1989)
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: synthetic minority over-sampling technique. J. Artif, Intell. Res. 16, 321–357 (2002)
Cook, J.A.: Chronologic: tracking stories of illness in chronic care. Ph.D. thesis (2014)
Coovert, S.A., Ducey, A., Grichanik, M., Coovert, M.D., Nelson, R.: Hey doc, is that your stethoscope?: increasing engagement in medical education and training with ipads. In: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion, pp. 71–74. ACM (2012)
Dai, H., D’Angelo, L.: A portable system for quantitative assessment of parkinsonian bradykinesia during deep-brain stimulation surgery. In: Advances in Biomedical Engineering (ICABME), 2013 2nd International Conference on, pp. 77–80. IEEE (2013)
Dai, H., Lin, H., Lueth, T.C.: Quantitative assessment of Parkinsonian bradykinesia based on an inertial measurement unit. Biomed. Eng. online 14(1), 68 (2015)
Ebersbach, G., Baas, H., Csoti, I., Mungersdorf, M., Deuschl, G.: Scales in Parkinson’s disease. J. Neurol. 253(4), 32–35 (2006)
Espay, A.J., Giuffrida, J.P., Chen, R., Payne, M., Mazzella, F., Dunn, E., Vaughan, J.E., Duker, A.P., Sahay, A., Kim, S.J., et al.: Differential response of speed, amplitude, and rhythm to dopaminergic medications in Parkinson’s disease. Mov. Disord. 26(14), 2504–2508 (2011)
Fox, C.M., Ramig, L.O.: Vocal sound pressure level and self-perception of speech and voice in men and women with idiopathic Parkinson disease. Am. J. Speech Lang. Pathol. 6(2), 85–94 (1997)
Ghika, J., Wiegner, A.W., Fang, J.J., Davies, L., Young, R.R., Growdon, J.H.: Portable system for quantifying motor abnormalities in Parkinson’s disease. IEEE Trans. Biomed. Eng. 40(3), 276–283 (1993)
Gil, L.M., Nunes, T.P., Silva, F.H., Faria, A.C., Melo, P.L.: Analysis of human tremor in patients with parkinson disease using entropy measures of signal complexity. In: Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE, pp. 2786–2789. IEEE (2010)
Goetz, C.G., Stebbins, G.T., Blasucci, L.M., Grobman, M.S.: Efficacy of a patient-training videotape on motor fluctuations for on–off diaries in Parkinson’s disease. Mov. Disord. 12(6), 1039–1041 (1997)
Goetz, C.G., Tilley, B.C., Shaftman, S.R., Stebbins, G.T., Fahn, S., Martinez-Martin, P., Poewe, W., Sampaio, C., Stern, M.B., Dodel, R., et al.: Movement disorder society-sponsored revision of the unified Parkinson’s disease rating scale (MDS–UPDRS): scale presentation and clinimetric testing results. Mov. Disord. 23(15), 2129–2170 (2008)
Golbe, L.I., Pae, J.: Validity of a mailed epidemiological questionnaire and physical self-assessment in Parkinson’s disease. Mov. Disord 3(3), 245–254 (1988)
Griffiths, R.I., Kotschet, K., Arfon, S., Xu, Z.M., Johnson, W., Drago, J., Evans, A., Kempster, P., Raghav, S., Horne, M.K.: Automated assessment of bradykinesia and dyskinesia in Parkinson’s disease. J. Parkinson’s Dis. 2(1), 47–55 (2012)
Group, P.S., et al.: Evaluation of dyskinesias in a pilot, randomized, placebo-controlled trial of remacemide in advanced Parkinson disease. Arch. Neurol. 58(10), 1660 (2001)
Hauser, R.A., Friedlander, J., Zesiewicz, T.A., Adler, C.H., Seeberger, L.C., O’brien, C.F., Molho, E.S., Factor, S.A.: A home diary to assess functional status in patients with Parkinson’s disease with motor fluctuations and dyskinesia. Clin. Neuropharmacol. 23(2), 75–81 (2000)
Hauser, R.A., Deckers, F., Lehert, P.: Parkinson’s disease home diary: further validation and implications for clinical trials. Mov. Disord. 19(12), 1409–1413 (2004)
Ho, T.K.: Random decision forests. In: Document analysis and recognition, 1995. Proceedings of the third international conference on, vol. 1, pp. 278–282. IEEE (1995)
Hoehn, M.M., Yahr, M.D., et al.: Parkinsonism: onset, progression, and mortality. Neurology 50(2), 318–318 (1998)
Hoff, J., v/d Plas, A., Wagemans, E., Van Hilten, J.: Accelerometric assessment of levodopa-induced dyskinesias in Parkinson’s disease. Mov. Disord 16(1), 58–61 (2001)
Jankovic, J.: Parkinson’s disease: clinical features and diagnosis. J. Neurol Neurosurg. Psychiatry 79(4), 368–376 (2008)
Kikuchi, S.: Motor fluctuations in Parkinson’s disease. J. Neurol. 254(5), 32–40 (2007)
Kim, J.W., Lee, J.H., Kwon, Y., Kim, C.S., Eom, G.M., Koh, S.B., Kwon, D.Y., Park, K.W.: Quantification of bradykinesia during clinical finger taps using a gyrosensor in patients with Parkinson’s disease. Med. Biol. Eng. Comput. 49(3), 365–371 (2011)
Krause, M., Smeddinck, J.D., Meyer, R.: A digital game to support voice treatment for Parkinson’s disease, pp. 445–450 (2013)
Liu, L.S., Hirano, S.H., Tentori, M., Cheng, K.G., George, S., Park, S.Y., Hayes, G.R.: Improving communication and social support for caregivers of high-risk infants through mobile technologies. In: Proceedings of the ACM 2011 conference on Computer supported cooperative work, pp. 475–484. ACM (2011)
Lukšys, D., Jonaitis, G., Griškevičius, J.: Quantitative analysis of parkinsonian tremor in a clinical setting using inertial measurement units. Parkinson’s Dis. 2018, (2018)
Lyons, K.E., Pahwa, R.: Electronic motor function diary for patients with Parkinson’s disease: a feasibility study. Parkinsonism Relat. Disord. 13(5), 304–307 (2007)
Mariakakis, A., Parsi, S., Patel, S.N., Wobbrock, J.O.: Drunk user interfaces: Determining blood alcohol level through everyday smartphone tasks. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 234. ACM (2018)
Marinus, J., Visser, M., Stiggelbout, A.M., Rabey, J.M., Bonuccelli, U., Kraus, P.H., van Hilten, J.B.J.: Activity-based diary for Parkinson’s disease. Clin. Neuropharmacol. 25(1), 43–50 (2002)
Mazilu, S., Blanke, U., Hardegger, M., Troster, G., Gazit, E., Hausdorff, J.M.: Gaitassist: a daily-life support and training system for Parkinson’s disease patients with freezing of gait, pp. 2531–2540 (2014)
Mcnaney, R., Vines, J., Roggen, D., Balaam, M., Zhang, P., Poliakov, I., Olivier, P.: Exploring the acceptability of google glass as an everyday assistive device for people with Parkinson’s, pp. 2551–2554 (2014)
Mcnaney, R., Poliakov, I., Vines, J., Balaam, M., Zhang, P., Olivier, P.: Lapp: a speech loudness application for people with Parkinson’s on google glass, pp. 497–500 (2015)
Mentis, H.M., Shewbridge, R., Powell, S., Fishman, P., Shulman, L.: Being seen: Co-interpreting parkinson’s patient’s movement ability in deep brain stimulation programming. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 511–520. ACM (2015)
Mentis, H.M., Shewbridge, R., Powell, S., Armstrong, M., Fishman, P., Shulman, L.: Co-interpreting movement with sensors: assessing parkinsons patients deep brain stimulation programming. Hum. Comput. Interact. 31(3–4), 227–260 (2016)
Mentis, H.M., Komlodi, A., Schrader, K., Phipps, M., Gruber-Baldini, A., Yarbrough, K., Shulman, L.: Crafting a view of self-tracking data in the clinical visit. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 5800–5812. ACM (2017)
Moore, S.T., MacDougall, H.G., Gracies, J.M., Cohen, H.S., Ondo, W.G.: Long-term monitoring of gait in Parkinson’s disease. Gait Posture 26(2), 200–207 (2007)
Morris, D., Saponas, T.S., Guillory, A., Kelner, I.: Recofit: using a wearable sensor to find, recognize, and count repetitive exercises. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3225–3234. ACM (2014)
Nyholm, D., Kowalski, J., Aquilonius, S.M.: Wireless real-time electronic data capture for self-assessment of motor function and quality of life in Parkinson’s disease. Mov. Disord. 19(4), 446–451 (2004)
Obeso, J.A., Olanow, C.W., Nutt, J.G.: Levodopa motor complications in Parkinson’s disease. Trends Neurosci. 23, S2–S7 (2000)
Patel, S., Lorincz, K., Hughes, R., Huggins, N., Growdon, J., Standaert, D., Akay, M., Dy, J., Welsh, M., Bonato, P.: Monitoring motor fluctuations in patients with Parkinson’s disease using wearable sensors. IEEE Trans. Inf. Technol. Biomed. 13(6), 864–873 (2009)
Patel, S., Chen, B.r., Buckley, T., Rednic, R., McClure, D., Tarsy, D., Shih, L., Dy, J., Welsh, M., Bonato, P.: Home monitoring of patients with parkinson’s disease via wearable technology and a web-based application. In: Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE, pp. 4411–4414. IEEE (2010)
Perumal, S.V., Sankar, R.: Gait and tremor assessment for patients with parkinson’s disease using wearable sensors. ICT Express 2(4), 168–174 (2016)
Reimer, J., Grabowski, M., Lindvall, O., Hagell, P.: Use and interpretation of on/off diaries in Parkinson’s disease. J. Neurol. Neurosurg. Psychiatry 75(3), 396–400 (2004)
Saito, N., Yamamoto, T., Sugiura, Y., Shimizu, S., Shimizu, M.: Lifecorder: a new device for the long-term monitoring of motor activities for Parkinson’s disease. Intern. Med. 43(8), 685–692 (2004)
Salarian, A., Russmann, H., Vingerhoets, F.J., Burkhard, P.R., Aminian, K.: Ambulatory monitoring of physical activities in patients with Parkinson’s disease. IEEE Trans. Biomed. Eng. 54(12), 2296–2299 (2007a)
Salarian, A., Russmann, H., Wider, C., Burkhard, P.R., Vingerhoets, F.J., Aminian, K.: Quantification of tremor and bradykinesia in Parkinson’s disease using a novel ambulatory monitoring system. IEEE Trans. Biomed. Eng. 54(2), 313–322 (2007b)
Salivia, G., Hourcade, J.P.: Identification of pointing difficulties of two individuals with parkinson’s disease via a sub-movement analysis. In: CHI’11 Extended Abstracts on Human Factors in Computing Systems, pp. 137–140. ACM (2011)
Schaafsma, J.D., Giladi, N., Balash, Y., Bartels, A.L., Gurevich, T., Hausdorff, J.M.: Gait dynamics in Parkinson’s disease: relationship to parkinsonian features, falls and response to levodopa. J. Neurol. Sci 212(1–2), 47–53 (2003)
Schapira, A.H., Chaudhuri, K.R., Jenner, P.: Non-motor features of Parkinson disease. Nat. Rev. Neurosci. 18(7), 435 (2017)
Spieker, S., Jentgens, C., Boose, A., Dichgans, J.: Reliability, specificity and sensitivity of long-term tremor recordings. Clin. Neurophysiol. 97(6), 326–331 (1995)
Vega, J., Couth, S., Poliakoff, E., Kotz, S., Sullivan, M., Jay, C., Vigo, M., Harper, S.: Back to analogue: Self-reporting for parkinson’s disease. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 74. ACM (2018)
Zwartjes, D.G., Heida, T., Van Vugt, J.P., Geelen, J.A., Veltink, P.H.: Ambulatory monitoring of activities and motor symptoms in Parkinson’s disease. IEEE Trans. Biomed. Eng. 57(11), 2778–2786 (2010)
Acknowledgements
We thank all subjects for participating in our study, and the clinicians of the Peking Union Medical College Hospital for their guidance. This work was supported by National Key R&D Program of China (Grant no. 2016YFB1001405).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, N., Tian, F., Fan, X. et al. Monitoring motor symptoms in Parkinson’s disease via instrumenting daily artifacts with inertia sensors. CCF Trans. Pervasive Comp. Interact. 1, 100–113 (2019). https://doi.org/10.1007/s42486-019-00008-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42486-019-00008-z