[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

Reasoning with smart objects’ affordance for personalized behavior monitoring in pervasive information systems

  • Regular Paper
  • Published:
Knowledge and Information Systems Aims and scope Submit manuscript

Abstract

The miniaturization of sensors and their integration in everyday appliances have opened the way for ecologically monitoring people’s behavior based on their interaction with smart objects. Thanks to behavior monitoring, mobile, and ubiquitous information systems in the areas of e-health, home automation, and smart cities are becoming more and more “smart,” being able to dynamically adapt themselves to the current users’ context and situation. However, human behavior is characterized by large variability due to individual habits, physical disabilities or cognitive impairment. This aspect makes behavior monitoring a challenging task. On the one side, execution variability makes it hard to acquire sufficiently large activity datasets needed by supervised learning methods. On the other side, being based on a strict definition of activities in terms of constituting simpler actions, existing knowledge-based frameworks fall short in adapting to the specific characteristics of the subject. Hence, the variability of activity execution by different subjects calls for personalized methods to capture human activities and interaction in smart spaces at a fine-grained level. In this paper, we address this challenge by proposing a novel hybrid reasoning framework to capture fine-grained interaction with smart objects considering the specific features of individuals. Our model has its roots in the well-founded psychological theory of affordances, i.e., those features of an object that naturally explain its possible uses and how it should be used. The core of the framework is the ontological model of smart objects affordance, expressed through the OWL 2 Web Ontology Language. Through a use case in pervasive healthcare, we show how our framework can be applied to personalized recognition of abnormal behaviors. In particular, we tackle a particularly challenging issue: how to recognize early behavioral symptoms of mild cognitive impairment in subjects with physical disabilities. Moreover, an extensive experimental evaluation with real-world datasets acquired from 24 subjects shows the effectiveness of our framework in recognizing human activities and fine-grained manipulative gestures in different pervasive computing environments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. http://people.unica.it/danieleriboni/smaff/.

  2. http://protege.stanford.edu/.

  3. http://www.opportunity-project.eu/challengeDownload.

  4. http://ailab.wsu.edu/casas/datasets/adlinterweave.zip.

References

  1. Ye J, Dobson S, McKeever S (2012) Situation identification techniques in pervasive computing: a review. Pervasive Mob Comput 8(1):36–66

    Article  Google Scholar 

  2. Gibson JJ (2014) The ecological approach to visual perception: classic edition. Psychology Press, New York

    Book  Google Scholar 

  3. Chemero A (2003) An outline of a theory of affordances. Ecol Psychol 15(2):181–195

    Article  Google Scholar 

  4. Grau BC, Horrocks I, Motik B, Parsia B, Patel-Schneider PF, Sattler U (2008) OWL 2: the next step for OWL. J Web Semant 6(4):309–322

    Article  Google Scholar 

  5. Suchman LA (1987) Plans and situated actions: the problem of human–machine communication. Cambridge university press, Cambridge

    Google Scholar 

  6. Dourish P (2004) Where the action is: the foundations of embodied interaction. MIT press, Cambridge

    Google Scholar 

  7. Levesque HJ, Pirri F, Reiter R (1998) Foundations for the situation calculus. Electron Trans Artif Intell 2:159–178

    MathSciNet  Google Scholar 

  8. Riboni D, Bettini C (2011a) Owl 2 modeling and reasoning with complex human activities. Pervasive Mob Comput 7(3):379–395

    Article  Google Scholar 

  9. Chen H, Perich F, Finin T, Joshi A (2004) Soupa: standard ontology for ubiquitous and pervasive applications. In: Proceedings of MobiQuitous. IEEE, pp 258–267

  10. Graves M, Constabaris A, Brickley D (2007) FOAF: connecting people on the semantic web. Cataloging Classif Q 43(3–4):191–202

    Article  Google Scholar 

  11. Hobbs JR, Pan F (2004) An ontology of time for the semantic web. ACM Trans Asian Lang Inf Process (TALIP) 3(1):66–85

    Article  Google Scholar 

  12. Lenat DB, Guha RV, Pittman K, Pratt D, Shepherd M (1990) Cyc: toward programs with common sense. Commun ACM 33(8):30–49

    Article  Google Scholar 

  13. Heckmann D, Schwartz T, Brandherm B, Schmitz M, von Wilamowitz-Moellendorff M (2005) Gumo—the general user model ontology. In: International conference on user modeling. Springer, pp 428–432

  14. Bonino D, Castellina E, Corno F (2008) The dog gateway: enabling ontology-based intelligent domotic environments. IEEE Trans Consum Electron 54(4):1656–1664

    Article  Google Scholar 

  15. Chen L, Nugent CD (2009) Ontology-based activity recognition in intelligent pervasive environments. Int J Web Inf Syst 5(4):410–430

    Article  Google Scholar 

  16. Riboni D, Bettini C (2011b) Cosar: hybrid reasoning for context-aware activity recognition. Pers Ubiquitous Comput 15(3):271–289

    Article  Google Scholar 

  17. Helaoui R, Riboni D, Stuckenschmidt H (2013) A probabilistic ontological framework for the recognition of multilevel human activities. In: Proceedings of UbiComp. ACM, pp 345–354

  18. Riboni D, Sztyler T, Civitarese G, Stuckenschmidt H (2016) Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning. In: Proceedings of ACM UbiComp 2016. ACM, pp 1–12

  19. Bouten CV, Koekkoek KT, Verduin M, Kodde R, Janssen JD (1997) A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity. IEEE Trans Bio-Med Eng 44(3):136–147

    Article  Google Scholar 

  20. Aminian K, Robert PH, Buchser EE, Rutschmann B, Hayoz D, Depairon M (1999) Physical activity monitoring based on accelerometry: validation and comparison with video observation. Med Biol Eng Comput 37(3):304–308

    Article  Google Scholar 

  21. Kern N, Schiele B, Schmidt A (2003) Multi-sensor activity context detection for wearable computing. In: First European symposium on ambient intelligence, volume 2875 of Lecture notes in computer science. Springer, pp 220–232

  22. Bao L, Intille S S (2004) Activity recognition from user-annotated acceleration data. In: Proceedings of pervasive computing, volume 3001 of Lecture notes in computer science. Springer, pp 1–17

  23. van Kasteren T, Noulas A K, Englebienne G, Kröse Ben JA (2008) Accurate activity recognition in a home setting. In: Proceedings of ACM UbiComp 2008, volume 344 of ACM ICPS. ACM, pp 1–9

  24. Philipose M, Fishkin KP, Perkowitz M, Patterson DJ, Fox D, Kautz HA, Hähnel D (2004) Inferring activities from interactions with objects. IEEE Pervasive Comput 3(4):50–57

    Article  Google Scholar 

  25. Fleury A, Vacher M, Noury N (2010) Svm-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results. IEEE Trans Inf Technol Biomed 14(2):274–283

    Article  Google Scholar 

  26. Lester J, Choudhury T, Kern N, Borriello G, Hannaford B (2005) A hybrid discriminative/generative approach for modeling human activities. In: Proceedings of the 19th international joint conference on artificial intelligence. Morgan Kaufmann Publishers Inc, San Francisco, pp 766–772

  27. Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern Part C 42(6):790–808

    Article  Google Scholar 

  28. Cook DJ, Feuz KD, Krishnan NC (2013) Transfer learning for activity recognition: a survey. Knowl Inf Syst 36(3):537–556

    Article  Google Scholar 

  29. Kaptelinin V, Nardi BA (2006) Acting with technology: activity theory and interaction design. MIT press, Cambridge

    Google Scholar 

  30. Baader F, Calvanese D, McGuinness DL, Nardi D, Patel-Schneider PF (2010) The description logic handbook: theory implementation and applications., 2nd edn. Cambridge University Press, New York ISBN 978-0521150118

    MATH  Google Scholar 

  31. Allen JF (1983) Maintaining knowledge about temporal intervals. Commun ACM 26(11):832–843

    Article  Google Scholar 

  32. Liu J, Zhong L, Wickramasuriya J, Vasudevan V (2009) uwave: accelerometer-based personalized gesture recognition and its applications. Pervasive Mob Comput 5(6):657–675

    Article  Google Scholar 

  33. Sacco G, Joumier V, Darmon N, Dechamps A, Derreumaux A, Lee JH, Piano J, Bordone N, Konig A, Teboul B, David R, Guerin O, Bremond F, Robert P (2012) Detection of activities of daily living impairment in alzheimer’s disease and mci using ict. Clin Interv Aging 7:539–549

    Article  Google Scholar 

  34. Seelye AM, Schmitter-Edgecombe M, Cook DJ, Crandall A (2013) Naturalistic assessment of everyday activities and prompting technologies in mild cognitive impairment. J Int Neuropsychol Soc 19(4):442–452

    Article  Google Scholar 

  35. Giovannetti T, Bettcher BM, Brennan L, Libon DJ, Burke M, Duey K, Nieves C, Wambach D (2008) Characterization of everyday functioning in mild cognitive impairment: a direct assessment approach. Dement Geriatr Cogn Disord 25:359–365

    Article  Google Scholar 

  36. Singla G, Cook DJ, Schmitter-Edgecombe M (2009) Tracking activities in complex settings using smart environment technologies. Int J Biosci Psychiatry Technol (IJBSPT) 1(1):25–35

    Google Scholar 

  37. Cook DJ, Crandall AS, Thomas BL, Krishnan NC (2013b) Casas: a smart home in a box. Computer 46(7):62–69

    Article  Google Scholar 

  38. Lukowicz P, Pirkl G, Bannach D, Wagner F, Calatroni A, Förster K, Holleczek T, Rossi M, Roggen D, Tröster G, Doppler J, Holzmann C, Riener A, Ferscha A, Chavarriaga R (2010) Recording a complex, multi modal activity data set for context recognition. In: Proceedings of ARCS ’10—23th international conference on architecture of computing systems. VDE Verlag, pp 161–166

  39. Plötz T, Hammerla N Y, Olivier P (2011) Feature learning for activity recognition in ubiquitous computing. In: Proceedings of IJCAI 2011. IJCAI/AAAI, pp 1729–1734

  40. Bhattacharya S, Lane N D (2016) From smart to deep: robust activity recognition on smartwatches using deep learning. In: Proceedings of 2016 IEEE PerCom workshops. IEEE, pp 1–6

  41. Zhang R, Li C (2015) Motion sequence recognition with multi-sensors using deep convolutional neural network. In: Proceedings of intelligent data analysis and applications, volume 370 of Advances in intelligent systems and computing. Springer, pp 13–23

  42. Wu D, Pigou L, Kindermans P-J, Do-Hoang Le N, Shao L, Dambre J, Odobez J-M (2016) Deep dynamic neural networks for multimodal gesture segmentation and recognition. IEEE Trans Pattern Anal Mach Intell 38(8):1583–1597

    Article  Google Scholar 

  43. Russell S, Norvig P (2010) Artificial intelligence—a modern approach, 3rd edn. Pearson Education, London ISBN 978-0-13-207148-2

    MATH  Google Scholar 

  44. Hall MA, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. SIGKDD Explor 11(1):10–18

    Article  Google Scholar 

  45. Knox S, Coyle L, Dobson S (2010) Using ontologies in case-based activity recognition. In: Proceedings of the twenty-third international Florida artificial intelligence research society conference. AAAI Press

  46. Ferro E, Girolami M, Salvi D, Mayer CC, Gorman J, Grguric A, Ram R, Sadat R, Giannoutakis KM, Stocklöw C (2015) The universaal platform for AAL (ambient assisted living). J Intell Syst 24(3):301–319

    Google Scholar 

  47. Ramparany F, Galán MF, Soriano J, Elsaleh T (2014) Handling smart environment devices, data and services at the semantic level with the FI-WARE core platform. In: 2014 IEEE international conference on big data. IEEE, pp 14–20

Download references

Acknowledgements

This work was partially supported by the “DomuSafe” project, funded by Region Sardinia (CRP 69, L.R. 7 agosto 2007, n.7). The authors wish to thank the anonymous reviewers for their insightful comments on several aspects involved in this work.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Turin, Turin, Italy

    Assunta Matassa

  2. Department of Mathematics and Computer Science, University of Cagliari, Cagliari, Italy

    Daniele Riboni

Authors
  1. Assunta Matassa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniele Riboni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniele Riboni.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Matassa, A., Riboni, D. Reasoning with smart objects’ affordance for personalized behavior monitoring in pervasive information systems. Knowl Inf Syst 62, 1255–1278 (2020). https://doi.org/10.1007/s10115-019-01357-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10115-019-01357-y

Keywords

Search

Navigation