More Web Proxy on the site http://driver.im/

research-article

Developing a serious game for cognitive assessment: choosing settings and measuring performance

Authors:

Mark ChignellAuthors Info & Claims

Chinese CHI '14: Proceedings of the Second International Symposium of Chinese CHI

Pages 70 - 79

https://doi.org/10.1145/2592235.2592246

Published: 26 April 2014 Publication History

Abstract

Gamification and serious games are becoming increasingly important for training, wellness, and other applications. How can games be developed for non-traditional gaming populations such as the elderly, and how can gaming be applied in non-traditional areas such as cognitive assessment? The application that we were interested in is detection of cognitive impairment in the elderly. Example use cases where gamified cognitive assessment might be useful are: prediction of delirium onset risk in emergency departments and postoperative hospital wards; evaluation of recovery from stroke in neuro-rehabilitation; monitoring of transitions from mild cognitive impairment to dementia in long-term care. With the rapid increase in cognitive disorders in many countries, inexpensive methods of measuring cognitive status on an ongoing basis, and to large numbers of people, are needed. In order to address this challenge we have developed a novel game-based method of cognitive assessment. In this paper, we present findings from a usability study conducted on the game that we developed for measuring changes in cognitive status. We report on the game's ability to predict cognitive status under varying game parameters, and we introduce a method to calibrate the game that takes into account differences in speed and accuracy, and in motor coordination. Recommendations concerning the development of serious games for cognitive assessment are made, and detailed recommendations concerning future development of the whack-a-mole game are also provided.

References

[1]

Baddeley, A. Working memory: looking back and looking forward. Nature reviews. Neuroscience 4, 10 (Oct. 2003), 829--39.

[2]

Barua, P., Bilder, R., Small, A., & Sharma, T. Standardisation Study of Cogtest. Schizophrenia Bulletin 31, 2 (2005).

[3]

Bergman Nutley, S., Söderqvist, S., Bryde, S., Thorell, L. B., Humphreys, K., and Klingberg, T. Gains in fluid intelligence after training non-verbal reasoning in 4-year-old children: a controlled, randomized study. Developmental science 14, 3 (May 2011), 591--601.

[4]

Christ, S. E., White, D. A., Mandernach, T., and Keys, B. A. Inhibitory control across the life span. Developmental neuropsychology 20, 3 (Jan. 2001), 653--69.

[5]

Diamond, A. Executive functions. Annual review of psychology 64 (Jan. 2013), 135--68.

[6]

Elliott, R. Executive functions and their disorders. British Medical Bulletin 65, 1 (Mar. 2003), 49--59.

[7]

Gamberini, L., Martino, F., Seraglia, B., Spagnolli, A., Fabregat, M., Ibanez, F., Alcaniz, M., and Andres, J. M. Eldergames project: An innovative mixed reality table-top solution to preserve cognitive functions in elderly people. In 2009 2nd Conference on Human System Interactions, IEEE (May 2009), 164--169.

Digital Library

[8]

Harwood, D. M., Hope, T., and Jacoby, R. Cognitive impairment in medical inpatients. II: Do physicians miss cognitive impairment? Age and ageing 26, 1 (Jan. 1997), 37--9.

[9]

Jacova, C., Kertesz, A., Blair, M., Fisk, J. D., and Feldman, H. H. Neuropsychological testing and assessment for dementia. Alzheimer's & dementia: the journal of the Alzheimer's Association 3, 4 (Oct. 2007), 299--317.

[10]

Johnson, J. K., Lui, L.-Y., and Yaffe, K. Executive Function, More Than Global Cognition, Predicts Functional Decline and Mortality in Elderly Women. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences 62, 10 (Oct. 2007), 1134--1141.

[11]

Kahneman, D. Thinking, Fast and Slow. Farrar, Straus and Giroux, 2011.

[12]

Kosslyn, E. E. S. S. M. Cognitive Psychology. Prentice Hall, 2008.

[13]

Miyake, A., and Friedman, N. P. The Nature and Organization of Individual Differences in Executive Functions: Four General Conclusions. Current directions in psychological science 21, 1 (Feb. 2012), 8--14.

[14]

Mizobuchi, S., Chignell, M., Suzuki, J., Koga, K., and Nawa, K. The Impact of Central Executive Function Loadings on Driving-Related Performance. In Adjunct Proceedings of AutomotiveUI'12 (2012), 68--75.

[15]

Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., and Chertkow, H. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society 53, 4 (Apr. 2005), 695--9.

[16]

Osman, A., Lou, L., Muller-Gethmann, H., Rinkenauer, G., Mattes, S., and Ulrich, R. Mechanisms of speed-accuracy tradeoff: evidence from covert motor processes. Biological psychology 51, 2-3 (Jan. 2000), 173--99.

[17]

Richmond, L. L., Morrison, A. B., Chein, J. M., and Olson, I. R. Working memory training and transfer in older adults. Psychology and aging 26, 4 (Dec. 2011), 813--22.

[18]

Robbins, T. W., James, M., Owen, A. M., Sahakian, B. J., McInnes, L., and Rabbitt, P. Cambridge Neuropsychological Test Automated Battery (CANTAB): a factor analytic study of a large sample of normal elderly volunteers. Dementia (Basel, Switzerland) 5, 5, 266--81.

[19]

Salthouse, T. A. What cognitive abilities are involved in trail-making performance? Intelligence 39, 4 (Jan. 2011), 222--232.

[20]

Saxena, S., and Lawley, D. Delirium in the elderly: a clinical review. Postgraduate medical journal 85, 1006 (Aug. 2009), 405--13.

[21]

Scott Mackenzie, S. X. Z. An empirical investigation of the novice experience with soft keyboards. Behaviour & Information Technology 20 (2001), 411--418.

[22]

Smith, P. J., Attix, D. K., Weldon, B. C., Greene, N. H., and Monk, T. G. Executive function and depression as independent risk factors for postoperative delirium. Anesthesiology 110, 4 (Apr. 2009), 781--7.

[23]

Strömberg, L., Lindgren, U., Nordin, C., Öhlén, G., and Svensson, O. The Appearance and Disappearance of Cognitive Impairment in Elderly Patients During Treatment for Hip Fracture. Scandinavian Journal of Caring Sciences 11, 3 (Sept. 1997), 167--175.

[24]

Woodford, H. J., and George, J. Cognitive assessment in the elderly: a review of clinical methods. QJM: monthly journal of the Association of Physicians 100, 8 (Aug. 2007), 469--84.

Cited By

Pacheco-Lorenzo MChristensen HAnido-Rifón LFernández-Iglesias MValladares-Rodríguez S(2024)Analysis of Voice Biomarkers for the Detection of Cognitive ImpairmentIEEE Access10.1109/ACCESS.2024.344243112(122840-122851)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3442431
Cubillos CRienzo A(2023)Digital Cognitive Assessment Tests for Older Adults: Systematic Literature ReviewJMIR Mental Health10.2196/4748710(e47487)Online publication date: 8-Dec-2023
https://doi.org/10.2196/47487
Christogianni ABojan KMukaetova-Ladinska ESriramm VMurthy GKumarpillai G(2023)Improvement in Motor Skills, Attention, and Working Memory in Mild Cognitive Impairment and Alzheimer’s Disease Patients Using COSMA Cognitive AppAugmented Human Research10.1007/s41133-023-00061-58:1Online publication date: 11-Dec-2023
https://doi.org/10.1007/s41133-023-00061-5
Show More Cited By

Index Terms

Recommendations

Monitoring Cognitive Performance with a Serious Game: A Longitudinal Case Study on Online Cognitive Assessment Using Serious Games
CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

This case study involves: the design and evaluation of serious games; the use of longitudinal research and remote testing in an international setting. Current methods for cognitive assessment tend to be inconvenient, costly and infrequently performed. ...
Designing game-based cognitive assessments for elderly adults
Gamification '13: Proceedings of the First International Conference on Gameful Design, Research, and Applications

Gamification is the use of game-like properties in non-game scenarios, and is applied in the design of our application to stimulate cognition, and enjoyment, which often decreases due to age-related changes. The goal of the research reported here is to ...
Serious Games for Dementia
WWW '17 Companion: Proceedings of the 26th International Conference on World Wide Web Companion

With the current phenomenon of aging populations in most parts of the world, there are corresponding increases in age-related conditions associated with impaired cognitive status, such as dementia and delirium. Cognitive status is a key component in ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

Chinese CHI '14: Proceedings of the Second International Symposium of Chinese CHI

April 2014

120 pages

ISBN:9781450328760

DOI:10.1145/2592235

Conference Chairs:
Ellen Yi-Luen Do
Georgia Institute of Technology & National University of Singapore
,
Wei Li
Autodesk Research

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Google Inc.
ICACHI: International Chinese Association of Computer Human Interaction
Autodesk: Autodesk

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Chinese CHI '14

Sponsor:

ICACHI
Autodesk

Chinese CHI '14: The Second International Symposium of Chinese CHI

April 26 - 27, 2014

Ontario, Toronto, Canada

Acceptance Rates

Overall Acceptance Rate 17 of 40 submissions, 43%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
990
Total Downloads

Downloads (Last 12 months)88
Downloads (Last 6 weeks)10

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pacheco-Lorenzo MChristensen HAnido-Rifón LFernández-Iglesias MValladares-Rodríguez S(2024)Analysis of Voice Biomarkers for the Detection of Cognitive ImpairmentIEEE Access10.1109/ACCESS.2024.344243112(122840-122851)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3442431
Cubillos CRienzo A(2023)Digital Cognitive Assessment Tests for Older Adults: Systematic Literature ReviewJMIR Mental Health10.2196/4748710(e47487)Online publication date: 8-Dec-2023
https://doi.org/10.2196/47487
Christogianni ABojan KMukaetova-Ladinska ESriramm VMurthy GKumarpillai G(2023)Improvement in Motor Skills, Attention, and Working Memory in Mild Cognitive Impairment and Alzheimer’s Disease Patients Using COSMA Cognitive AppAugmented Human Research10.1007/s41133-023-00061-58:1Online publication date: 11-Dec-2023
https://doi.org/10.1007/s41133-023-00061-5
Ahmad FAhmed ZShaheen MMuneeb SRiasat R(2023)A pilot study on the evaluation of cognitive abilities’ cluster through game-based intelligent techniqueMultimedia Tools and Applications10.1007/s11042-023-15100-x82:26(41323-41341)Online publication date: 10-Apr-2023
https://dl.acm.org/doi/10.1007/s11042-023-15100-x
Ford EMilne RCurlewis K(2023)Ethical issues when using digital biomarkers and artificial intelligence for the early detection of dementiaWIREs Data Mining and Knowledge Discovery10.1002/widm.149213:3Online publication date: 19-Feb-2023
https://doi.org/10.1002/widm.1492
Pas MOlde Rikkert MBouwman AKessels RBuise M(2022)Screening for Mild Cognitive Impairment in the Preoperative Setting: A Narrative ReviewHealthcare10.3390/healthcare1006111210:6(1112)Online publication date: 15-Jun-2022
https://doi.org/10.3390/healthcare10061112
Valladares-Rodríguez SFernández-Iglesias MAnido-Rifón LPacheco-Lorenzo M(2022)Evaluation of the Predictive Ability and User Acceptance of Panoramix 2.0, an AI-Based E-Health Tool for the Detection of Cognitive ImpairmentElectronics10.3390/electronics1121342411:21(3424)Online publication date: 22-Oct-2022
https://doi.org/10.3390/electronics11213424
Wei HHu YChignell MMeltzer J(2022)Picture-Word Interference Effects Are Robust With Covert Retrieval, With and Without GamificationFrontiers in Psychology10.3389/fpsyg.2021.82502012Online publication date: 20-Jan-2022
https://doi.org/10.3389/fpsyg.2021.825020
Wang PFang YQi JLi H(2022)FISHERMAN: A Serious Game for Executive Function Assessment of Older AdultsAssessment10.1177/1073191122110564830:5(1499-1513)Online publication date: 28-Jun-2022
https://doi.org/10.1177/10731911221105648
Simpson AAn YEstep JSaraf ARaiti J(2022)A Gamified Approach to Cognitive Assessment with Machine Learning Based Predictions2022 IEEE Global Humanitarian Technology Conference (GHTC)10.1109/GHTC55712.2022.9910615(441-444)Online publication date: 8-Sep-2022
https://doi.org/10.1109/GHTC55712.2022.9910615
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents