[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3643832.3661844acmconferencesArticle/Chapter ViewAbstractPublication PagesmobisysConference Proceedingsconference-collections
demonstration

Demo: EmoMarker: A Privacy-Preserving, Multi-Modal Sensing System for Dyadic Digital Biomarkers of Expressed Emotions for Patients with Dementia

Published: 04 June 2024 Publication History

Abstract

Alzheimer's disease and related dementia has emerged as a global health challenge due to aging population. Expressed Emotion (EE) is a widely-used medical measure of family emotional environment of patients with caregivers. We present EmoMarker, a multi-modal sensor detection system for dyadic digital biomarkers of EE in dementia patients' homes. EmoMarker consists of a privacy-preserving depth camera and a microphone to extracts interpretable dyadic (i.e., motor and acoustic) digital biomarkers of the interaction between patients and caregivers and predict the scores of Family Altitude Scale, an assessment tool for measuring the emotional climate of families. We have deployed our system in 99 elder people's homes and achieved 81.13% prediction accuracy in preliminary results.

References

[1]
R. L. Butzlaff and J. M. Hooley. Expressed emotion and psychiatric relapse: a meta-analysis. Archives of general psychiatry, 55(6):547--552, 1998.
[2]
H. Chen, S. Munir, and S. Lin. Rfcam: Uncertainty-aware fusion of camera and wi-fi for real-time human identification with mobile devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2022.
[3]
M. A. DeTure and D. W. Dickson. The neuropathological diagnosis of alzheimer's disease. Molecular neurodegeneration, 14(1):32, 2019.
[4]
S. Doris, T. Kwok, J. Choy, and D. J. Kavanagh. Measuring the expressed emotion in chinese family caregivers of persons with dementia: Validation of a chinese version of the family attitude scale. International journal of nursing studies, 2016.
[5]
H. Huang, H. Chen, and S. Lin. Magtrack: Enabling safe driving monitoring with wearable magnetics. In Proceedings of the 17th annual international conference on mobile systems, applications, and services, 2019.
[6]
K. Ma, H. Chen, and S. Lin. An ensemble learning approach for exercise detection in patients with type 1 diabetes. In Proceedings of the 2023 7th International Conference on Big Data and Internet of Things, 2023.
[7]
J. Solawetz. What is yolov8. The Ultimate Guide., 2023.
[8]
C. Spearman. The proof and measurement of association between two things. 1961.
[9]
E. Y. Tan, M. E. de Vugt, K. Deckers, J. M. Schols, and F. R. Verhey. Interaction of caregiver-expressed emotions and neuropsychiatric symptoms in persons with dementia: a longitudinal cohort study. BMJ open, 2021.
[10]
L. Wang, Z. Tong, B. Ji, and G. Wu. TDN: Temporal difference networks for efficient action recognition. In IEEE/CVF conference on CVPR, 2021.
[11]
S. Watanabe, T. Hori, S. Karita, T. Hayashi, J. Nishitoba, Y. Unno, N. E. Y. Soplin, J. Heymann, M. Wiesner, N. Chen, et al. ESPnet: End-to-end speech processing toolkit. arXiv preprint arXiv:1804.00015, 2018.
[12]
Y. Wu, Y. Chen, L. Wang, Y. Ye, Z. Liu, Y. Guo, and Y. Fu. Large scale incremental learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2019.

Cited By

View all
  • (2024)SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches2024 IEEE 21st International Conference on Mobile Ad-Hoc and Smart Systems (MASS)10.1109/MASS62177.2024.00066(453-459)Online publication date: 23-Sep-2024

Index Terms

  1. Demo: EmoMarker: A Privacy-Preserving, Multi-Modal Sensing System for Dyadic Digital Biomarkers of Expressed Emotions for Patients with Dementia

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      MOBISYS '24: Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services
      June 2024
      778 pages
      ISBN:9798400705816
      DOI:10.1145/3643832
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s).

      Sponsors

      In-Cooperation

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 04 June 2024

      Check for updates

      Author Tags

      1. expressed emotion
      2. digital biomarkers
      3. multi-modal sensing system
      4. Alzheimer's disease

      Qualifiers

      • Demonstration

      Funding Sources

      • Research Grants Council - Collaborative Research Fund
      • Alzheimer's Drug Discovery Foundation

      Conference

      MOBISYS '24
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 274 of 1,679 submissions, 16%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)104
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 09 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)SensEmo: Enabling Affective Learning through Real-time Emotion Recognition with Smartwatches2024 IEEE 21st International Conference on Mobile Ad-Hoc and Smart Systems (MASS)10.1109/MASS62177.2024.00066(453-459)Online publication date: 23-Sep-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media