Abstract
Dementia is one of the leading causes of disability and dependency among older people worldwide. To address the challenges faced by people with dementia, vision-based technologies have been proposed to provide context-aware assistance. These technologies typically rely on cameras to understand actions and tailor assistance accordingly. However, privacy concerns hinder their adoption, particularly in privacy-sensitive contexts. This study proposes the use of 4D point clouds as a privacy-preserving modality for assistive systems. By relying only on 3D data and excluding RGB information, we aim to enable personalised assistance while mitigating privacy risks.
To assess the feasibility of this approach, we collect a real-world dataset with the help of 16 people with dementia and evaluate the state-of-the-art P4Transformer model on this dataset. Our results show promising performance, demonstrating the viability of point clouds as a practical alternative for privacy-sensitive action recognition in real-world settings. However, the model does not achieve the performance attained on benchmark datasets, highlighting the importance of adapting models to deal with the complexity of real-world data.
By addressing privacy challenges and validating the model with real-world datasets, this research contributes to the advancement of privacy-aware assistive systems for people with dementia, towards more personalised and effective dementia care.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ballester, I., Kampel, M.: Automated vision-based toilet assistance for people with dementia. Hum. Factors Accessibility Assistive Technol. 37, 21 (2022). https://doi.org/10.54941/ahfe1001638
Ballester, I., Mujirishvili, T., Kampel, M.: RITA: a privacy-aware toileting assistance designed for people with dementia. In: Lewy, H., Barkan, R. (eds.) PH 2021. LNICST, vol. 431, pp. 318–330. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-99194-4_20
Das, S., et al.: Toyota smarthome: real-world activities of daily living. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 833–842 (2019)
Fan, H., Yang, Y.: PointRNN: point recurrent neural network for moving point cloud processing. arXiv preprint arXiv:1910.08287 (2019)
Fan, H., Yang, Y., Kankanhalli, M.: Point 4D transformer networks for spatio-temporal modeling in point cloud videos. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14204–14213 (2021)
Li, W., Zhang, Z., Liu, Z.: Action recognition based on a bag of 3D points. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, pp. 9–14. IEEE (2010)
Liu, X., Yan, M., Bohg, J.: MeteorNet: deep learning on dynamic 3D point cloud sequences. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9246–9255 (2019)
Maidhof, C., Offermann, J., Ziefle, M.: Eyes on privacy: acceptance of video-based AAL impacted by activities being filmed. Front. Public Health 11 (2023)
Mucha, W., Kampel, M.: Addressing privacy concerns in depth sensors. In: Miesenberger, K., Kouroupetroglou, G., Mavrou, K., Manduchi, R., Covarrubias Rodriguez, M., Penaz, P. (eds.) ICCHP-AAATE 2022. LNCS, vol. 13342, pp. 526–533. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-08645-8_62
Pappadà, A., Chattat, R., Chirico, I., Valente, M., Ottoboni, G.: Assistive technologies in dementia care: an updated analysis of the literature. Front. Psychol. 12, 644587 (2021). https://doi.org/10.3389/fpsyg.2021.644587
Qi, C.R., Yi, L., Su, H., Guibas, L.J.: PointNet++: deep hierarchical feature learning on point sets in a metric space. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., Paluri, M.: A closer look at spatiotemporal convolutions for action recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6450–6459 (2018)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wei, Y., Liu, H., Xie, T., Ke, Q., Guo, Y.: Spatial-temporal transformer for 3D point cloud sequences. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1171–1180 (2022)
World Health Organization (WHO): Global status report on the public health response to dementia (2021)
Zhang, X., Liu, L., Long, G., Jiang, J., Liu, S.: Episodic memory governs choices: an RNN-based reinforcement learning model for decision-making task. Neural Netw. 134, 1–10 (2021)
Acknowledgements
This work is partially funded by WWTF under project number ICT20-055 for the AlgoCare project and by the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement number 861091 for the visuAAL project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Ballester, I., Kampel, M. (2024). Action Recognition from 4D Point Clouds for Privacy-Sensitive Scenarios in Assistive Contexts. In: Miesenberger, K., Peňáz, P., Kobayashi, M. (eds) Computers Helping People with Special Needs. ICCHP 2024. Lecture Notes in Computer Science, vol 14751. Springer, Cham. https://doi.org/10.1007/978-3-031-62849-8_44
Download citation
DOI: https://doi.org/10.1007/978-3-031-62849-8_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-62848-1
Online ISBN: 978-3-031-62849-8
eBook Packages: Computer ScienceComputer Science (R0)