More Web Proxy on the site http://driver.im/

research-article

A smart dialogue-competent monitoring framework supporting people in rehabilitation

Authors:

Thanassis Mavropoulos,

Georgios Meditskos,

Eleni Kamateri,

Spyridon Symeonidis,

Dimitris Tzimikas,

Lefteris Papageorgiou,

Christos Eleftheriadis,

George Adamopoulos,

Stefanos Vrochidis,

Ioannis KompatsiarisAuthors Info & Claims

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Pages 499 - 508

https://doi.org/10.1145/3316782.3322755

Published: 05 June 2019 Publication History

Abstract

In this paper, we present work in progress on the development of a smart monitoring framework to support people with motor disabilities and their caregivers in clinical and non-clinical rehabilitation and care environments. The innovation of the platforms lies in the combination of smart monitoring solutions, such as activity recognition and lifestyle tracking, with an intelligent virtual agent that aims to empower and motivate people in need through personalized feedback and responses, as well as to assist caregivers and clinicians to easily collect information about the patients. The proposed system exploits and combines state-of-the-art technologies in speech recognition and synthesis, knowledge representation and reasoning, dialogue management and sensor data analysis, infusing clinical knowledge and patient history. Aiming for a practical, acceptable solution, the proposed system takes into account aspects of integration, security and privacy.

References

[1]

Duygu Altinok. 2018. An ontology-based dialogue management system for banking and finance dialogue systems. arXiv preprint arXiv.1804.04838.

[2]

Konstantinos Avgerinakis, Alexia Briassouli, and Ioannis Kompatsiaris. 2013. Recognition of activities of daily living for smart home environments. In 2013 9th International Conference on Intelligent Environments, 173--180.

Digital Library

[3]

Franz Baader, Diego Calvanese, Deborah McGuinness, Peter Patel-Schneider, and Daniele Nardi. 2003. The description logic handbook. Theory, implementation and applications. Cambridge university press.

Digital Library

[4]

Jerome R Bellegarda and Christof Monz. 2016. State of the art in statistical methods for language and speech processing. Computer Speech & Language 35: 163--184.

Digital Library

[5]

Leo Breiman. 2001. Random forests. Machine learning 45, 1: 5--32.

Digital Library

[6]

Danica Damljanović, Milan Agatonović, Hamish Cunningham, and Kalina Bontcheva. 2013. Improving habitability of natural language interfaces for querying ontologies with feedback and clarification dialogues. Web Semantics. Science, Services and Agents on the World Wide Web 19: 1--21.

[7]

Sébastien Dourlens, Amar Ramdane-Cherif, and Eric Monacelli. 2013. Multi levels semantic architecture for multimodal interaction. Applied intelligence 38, 4: 586--599.

Digital Library

[8]

Aldo Gangemi and Peter Mika. 2003. Understanding the semantic web through descriptions and situations. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems", 689--706.

[9]

Albert Gatt and Emiel Krahmer. 2018. Survey of the state of the art in natural language generation: Core tasks, applications and evaluation. Journal of Artificial Intelligence Research 61: 65--170.

Digital Library

[10]

Bernardo Cuenca Grau, Ian Horrocks, Boris Motik, Bijan Parsia, Peter Patel-Schneider, and Ulrike Sattler. 2008. OWL 2: The next step for OWL. Web Semantics: Science, Services and Agents on the World Wide Web 6, 4: 309--322.

Digital Library

[11]

Juergen Heit, Soundararajan Srinivasan, Diego Benitez, and Burton Warren Andrews. 2013. Device and method to monitor, assess and improve quality of sleep.

[12]

Julian Hough. 2011. Incremental semantics driven natural language generation with self-repairing capability. In Proceedings of the Second Student Research Workshop associated with RANLP 2011, 79--84.

[13]

Ye Jia, Yu Zhang, Ron Weiss, Quan Wang, Jonathan Shen, Fei Ren, Patrick Nguyen, Ruoming Pang, Ignacio Lopez Moreno, Yonghui Wu, and others. 2018. Transfer learning from speaker verification to multispeaker text-to-speech synthesis. In Advances in Neural Information Processing Systems, 4485--4495.

Digital Library

[14]

Pierre Lison. 2014. Structured probabilistic modelling for dialogue management.

[15]

David D Luxton, Jennifer D June, Akane Sano, and Timothy Bickmore. 2016. Intelligent mobile, wearable, and ambient technologies for behavioral health care. In Artificial Intelligence in Behavioral and Mental Health Care. Elsevier, 137--162.

[16]

Christopher Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In Proceedings of 52nd annual meeting of the association for computational linguistics. system demonstrations, 55--60.

[17]

Thanassis Mavropoulos, Dimitris Liparas, Spyridon Symeonidis, Stefanos Vrochidis, and Ioannis Kompatsiaris. 2017. A Hybrid approach for biomedical relation extraction using finite state automata and random forest-weighted fusion. In International Conference on Computational Linguistics and Intelligent Text Processing, 450--462.

[18]

Georgios Meditskos, Stamatia Dasiopoulou, and Ioannis Kompatsiaris. 2016. MetaQ: A knowledge-driven framework for context-aware activity recognition combining SPARQL and OWL 2 activity patterns. Pervasive and Mobile Computing 25: 104--124.

Digital Library

[19]

Behzad Mirmahboub, Shadrokh Samavi, Nader Karimi, and Shahram Shirani. 2013. Automatic monocular system for human fall detection based on variations in silhouette area. IEEE Transactions on Biomedical Engineering 60, 2: 427--436.

[20]

Aaron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016. Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499.

[21]

Rivindu Perera and Parma Nand. 2017. Recent advances in natural language generation: A survey and classification of the empirical literature. Computing and Informatics 36, 1: 1--32.

[22]

June J Pilcher, Douglas R Ginter, and Brigitte Sadowsky. 1997. Sleep quality versus sleep quantity: relationships between sleep and measures of health, well-being and sleepiness in college students. Journal of psychosomatic research 42, 6: 583--596.

[23]

Vincent Pollet, Enrico Zovato, Sufian Irhimeh, and Pier Domenico Batzu. 2017. Unit Selection with Hierarchical Cascaded Long Short Term Memory Bidirectional Recurrent Neural Nets. In INTERSPEECH, 3966--3970.

[24]

Louisa Pragst, Juliana Miehle, Wolfgang Minker, and Stefan Ultes. 2017. Challenges for adaptive dialogue management in the KRISTINA project. In Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents, 11--14.

Digital Library

[25]

Ehud Reiter and Robert Dale. 2000. Building natural language generation systems. Cambridge university press.

Digital Library

[26]

Caroline Rougier, Jean Meunier, Alain St-Arnaud, and Jacqueline Rousseau. 2006. Monocular 3D head tracking to detect falls of elderly people. In 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, 6384--6387.

[27]

Ryan Shaw, Raphaël Troncy, and Lynda Hardman. 2009. Lode: Linking open descriptions of events. In Asian semantic web conference, 153--167.

Digital Library

[28]

Jonathan Shen, Ruoming Pang, Ron J Weiss, Mike Schuster, Navdeep Jaitly, Zongheng Yang, Zhifeng Chen, Yu Zhang, Yuxuan Wang, Rj Skerrv-Ryan, and others. 2018. Natural tts synthesis by conditioning wavenet on mel spectrogram predictions. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4779--4783.

Digital Library

[29]

Keiichi Tokuda, Yoshihiko Nankaku, Tomoki Toda, Heiga Zen, Junichi Yamagishi, and Keiichiro Oura. 2013. Speech synthesis based on hidden Markov models. Proceedings of the IEEE 101, 5: 1234--1252.

[30]

Shubham Toshniwal, Anjuli Kannan, Chung-Cheng Chiu, Yonghui Wu, Tara N Sainath, and Karen Livescu. 2018. A comparison of techniques for language model integration in encoder-decoder speech recognition. arXiv preprint arXiv:1807.10857.

[31]

Yuxi Wang, Kaishun Wu, and Lionel M Ni. 2017. Wifall: Device-free fall detection by wireless networks. IEEE Transactions on Mobile Computing 16, 2: 581--594.

Digital Library

[32]

Michael Wessel, Girish Acharya, James Carpenter, and Min Yin. 2019. OntoVPAAn Ontology-Based Dialogue Management System for Virtual Personal Assistants. In Advanced Social Interaction with Agents. Springer, 219--233.

[33]

Juan Ye, Stamatia Dasiopoulou, Graeme Stevenson, Georgios Meditskos, Efstratios Kontopoulos, Ioannis Kompatsiaris, and Simon Dobson. 2015. Semantic web technologies in pervasive computing: A survey and research roadmap. Pervasive andMobile Computing 23: 1--25.

Digital Library

[34]

Heiga Ze, Andrew Senior, and Mike Schuster. 2013. Statistical parametric speech synthesis using deep neural networks. In 2013 ieee international conference on acoustics, speech and signal processing, 7962--7966.

[35]

Yaniv Zigel, Dima Litvak, and Israel Gannot. 2009. A method for automatic fall detection of elderly people using floor vibrations and sound. Proof of concept on human mimicking doll falls. IEEE Transactions on Biomedical Engineering 56, 12: 2858--2867.

Cited By

Mavropoulos TSymeonidis STsanousa AGiannakeris PRousi MKamateri EMeditskos GIoannidis KVrochidis SKompatsiaris I(2021)Smart integration of sensors, computer vision and knowledge representation for intelligent monitoring and verbal human-computer interactionJournal of Intelligent Information Systems10.1007/s10844-021-00648-7Online publication date: 10-Jun-2021
https://doi.org/10.1007/s10844-021-00648-7
Giannakeris PTsanousa AMavropoulos TMeditskos GIoannidis KVrochidis SKompatsiaris I(2021)Fusion of Multimodal Sensor Data for Effective Human Action Recognition in the Service of Medical PlatformsMultiMedia Modeling10.1007/978-3-030-67835-7_31(367-378)Online publication date: 21-Jan-2021
https://doi.org/10.1007/978-3-030-67835-7_31
Trabelsi NMoussa RJemni M(2019)UVCA: a Unified Vocal Commands Approach for Mobile Applications2019 7th International conference on ICT & Accessibility (ICTA)10.1109/ICTA49490.2019.9144885(1-4)Online publication date: Dec-2019
https://doi.org/10.1109/ICTA49490.2019.9144885

Index Terms

A smart dialogue-competent monitoring framework supporting people in rehabilitation

Recommendations

Mining ontological knowledge using Nyaya framework

Ontology has become the buzzword of the knowledge and semantics community. The process of automatically constructing an ontology with completeness and reduced time has become the need of the hour. This paper presents the method for automatically ...
Integration of HL7 compliant smart home healthcare system and HMIS
ICOST'12: Proceedings of the 10th international smart homes and health telematics conference on Impact Ananlysis of Solutions for Chronic Disease Prevention and Management

Smart Home Healthcare Systems requires interoperability at different levels for effective provision of healthcare. Patients should be monitored regularly by medical doctors, whereas, medical doctors are themselves busy. Medical data exchange is ...
Distributed framework for tele health monitoring system
ACWR '11: Proceedings of the 1st International Conference on Wireless Technologies for Humanitarian Relief

In recent years, it has been a challenge to design and implement remote health care and monitoring services, with an objective to extend instant cost effective treatment and supply of life saving drugs. There are specialized disciplines in medical ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

June 2019

655 pages

ISBN:9781450362320

DOI:10.1145/3316782

Conference Chair:
Fillia Makedon
University of Texas at Arlington

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PETRA '19

PETRA '19: The 12th PErvasive Technologies Related to Assistive Environments Conference

June 5 - 7, 2019

Rhodes, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
195
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mavropoulos TSymeonidis STsanousa AGiannakeris PRousi MKamateri EMeditskos GIoannidis KVrochidis SKompatsiaris I(2021)Smart integration of sensors, computer vision and knowledge representation for intelligent monitoring and verbal human-computer interactionJournal of Intelligent Information Systems10.1007/s10844-021-00648-7Online publication date: 10-Jun-2021
https://doi.org/10.1007/s10844-021-00648-7
Giannakeris PTsanousa AMavropoulos TMeditskos GIoannidis KVrochidis SKompatsiaris I(2021)Fusion of Multimodal Sensor Data for Effective Human Action Recognition in the Service of Medical PlatformsMultiMedia Modeling10.1007/978-3-030-67835-7_31(367-378)Online publication date: 21-Jan-2021
https://doi.org/10.1007/978-3-030-67835-7_31
Trabelsi NMoussa RJemni M(2019)UVCA: a Unified Vocal Commands Approach for Mobile Applications2019 7th International conference on ICT & Accessibility (ICTA)10.1109/ICTA49490.2019.9144885(1-4)Online publication date: Dec-2019
https://doi.org/10.1109/ICTA49490.2019.9144885

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents