Investigating the Potential of User Interface Shortcuts and Control Panes to Support Mobile Phone Use by People with Mild Dementia – a Diary Study
Authors: 
Emma Dixon, Xiang Xiao, Rain Breaw Michaels, Yu Zhong, Ajit Narayanan, 
Erin BuehlerAuthors Info & Claims
Article No.: 208, Pages 1 - 7
Abstract
Given the necessity of mobile phones to participate in everyday life and past research indicating the inaccessibility of mobile phones for people with dementia, there is a need to design more accessible mobile interactions to ensure their full inclusion in society. We conducted a two-week diary study with three people with mild dementia to investigate their experiences with and perceptions of user interface (UI) shortcuts and control panes. Findings from this study demonstrate the potential of UI shortcuts and control panes to address specific mobile phone accessibility challenges people with mild dementia experience. This work provides a technical contribution in the form of control panes for mobile phones, as well as design considerations to improve the viability of mobile phone shortcuts and controls panes as future assistive technology for individuals with diverse cognitive abilities.
Supplemental Material
- Download
- 10.73 MB
- Transcript
References
[1]
Gazihan Alankus, Rachel Proffitt, Caitlin Kelleher, and Jack Engsberg. 2011. Stroke Therapy through Motion-Based Games: A Case Study. ACM Transactions on Accessible Computing 4, 1: 3:1-3:35. https://doi.org/10.1145/2039339.2039342
[2]
Android Developers. 2022. AccessibilityService. Android Developers. Retrieved June 17, 2022 from https://developer.android.com/reference/android/accessibilityservice/AccessibilityService
[3]
Chongyang Bai, Xiaoxue Zang, Ying Xu, Srinivas Sunkara, Abhinav Rastogi, Jindong Chen, and Blaise Aguera y Arcas. 2021. UIBert: Learning Generic Multimodal Representations for UI Understanding. https://doi.org/10.48550/arXiv.2107.13731
[4]
Ceylan Beşevli, Oğuz Turan Buruk, Merve Erkaya, and Oğuzhan Özcan. 2018. Investigating the Effects of Legacy Bias: User Elicited Gestures from the End Users Perspective. In Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive Systems (DIS ’18 Companion), 277–281. https://doi.org/10.1145/3197391.3205449
[5]
Rolf Black, Annalu Waller, Nava Tintarev, Ehud Reiter, and Joseph Reddington. 2011. A mobile phone based personal narrative system. In The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility (ASSETS ’11), 171–178. https://doi.org/10.1145/2049536.2049568
[6]
Virginia Braun, Victoria Clarke, Nikki Hayfield, and Gareth Terry. 2019. Thematic Analysis. In Handbook of Research Methods in Health Social Sciences, Pranee Liamputtong (ed.). Springer, Singapore, 843–860. https://doi.org/10.1007/978-981-10-5251-4_103
[7]
Lia Carrari, Rain Michaels, Ajit Narayanan, Lei Shi, and Xiang Xiao. 2020. Action Blocks: Making Mobile Technology Accessible for People with Cognitive Disabilities. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 1–4. https://doi.org/10.1145/3373625.3418043
[8]
Yi Chu, Pat Brown, Mark Harniss, Henry Kautz, and Kurt Johnson. 2014. Cognitive support technologies for people with TBI: current usage and challenges experienced. Disability and Rehabilitation: Assistive Technology 9, 4: 279–285. https://doi.org/10.3109/17483107.2013.823631
[9]
Emma Dixon, Jesse Anderson, and Amanda Lazar. 2022. Understanding How Sensory Changes Experienced by Individuals with a Range of Age-Related Cognitive Changes can Affect Technology Use. ACM Transactions on Accessible Computing. https://doi.org/10.1145/3511906
[10]
Emma Dixon and Amanda Lazar. 2020. The Role of Sensory Changes in Everyday Technology use by People with Mild to Moderate Dementia. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’20), 1–12. https://doi.org/10.1145/3373625.3417000
[11]
Emma Dixon, Rain Michaels, Xiang Xiao, Yu Zhong, Patrick Clary, Ajit Narayanan, Robin Brewer, and Amanda Lazar. 2022. Mobile Phone Use by People with Mild to Moderate Dementia: Uncovering Challenges and Identifying Opportunities. In The 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’22).
[12]
Emma Dixon, Anne Marie Piper, and Amanda Lazar. 2021. “Taking care of myself as long as I can”: How People with Dementia Configure Self-Management Systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–14. https://doi.org/10.1145/3411764.3445225
[13]
Christopher Frauenberger. 2015. Disability and Technology: A Critical Realist Perspective. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility - ASSETS ’15, 89–96. https://doi.org/10.1145/2700648.2809851
[14]
Gary Gowans, Jim Campbell, Norm Alm, Richard Dye, Arlene Astell, and Maggie Ellis. 2004. Designing a multimedia conversation aid for reminiscence therapy in dementia care environments. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’04), 825–836. https://doi.org/10.1145/985921.985943
[15]
Jose Guzman-Parra, Pilar Barnestein-Fonseca, Gloria Guerrero-Pertiñez, Peter Anderberg, Luis Jimenez-Fernandez, Esperanza Valero-Moreno, Jessica Marian Goodman-Casanova, Antonio Cuesta-Vargas, Maite Garolera, Maria Quintana, Rebeca I García-Betances, Evi Lemmens, Johan Sanmartin Berglund, and Fermin Mayoral-Cleries. 2020. Attitudes and Use of Information and Communication Technologies in Older Adults With Mild Cognitive Impairment or Early Stages of Dementia and Their Caregivers: Cross-Sectional Study. Journal of Medical Internet Research 22, 6: e17253. https://doi.org/10.2196/17253
[16]
Kat Holmes. 2018. Mismatch: How Inclusion Shapes Design. MIT Press, Cambridge, MA, USA.
[17]
Arjunsinh Jadeja. 2022. Elder Launcher. Retrieved October 13, 2022 from https://github.com/itsarjunsinh/elder_launcher
[18]
Christophe Jarry, François Osiurak, Josselin Baumard, Mathieu Lesourd, Clémence Coiffard, Charlène Lucas, Catherine Merck, Frédérique Etcharry-Bouyx, Valérie Chauviré, Serge Belliard, Olivier Moreaud, Bernard Croisile, and Didier Le Gall. 2021. Daily life activities in patients with Alzheimer's disease or semantic dementia: Multitasking assessment. Neuropsychologia 150: 107714. https://doi.org/10.1016/j.neuropsychologia.2020.107714
[19]
Yvonne Kerkhof, Ad Bergsma, Maud Graff, and Rose-Marie Dröes. 2017. Selecting apps for people with mild dementia: Identifying user requirements for apps enabling meaningful activities and self-management. Journal of Rehabilitation and Assistive Technologies Engineering 4: 2055668317710593. https://doi.org/10.1177/2055668317710593
[20]
Yvonne Kerkhof, Myrna Pelgrum-Keurhorst, Floriana Mangiaracina, Ad Bergsma, Guus Vrauwdeunt, Maud Graff, and Rose-Marie Dröes. 2019. User-participatory development of FindMyApps; a tool to help people with mild dementia find supportive apps for self-management and meaningful activities. DIGITAL HEALTH 5: 205520761882294. https://doi.org/10.1177/2055207618822942
[21]
Anne Köpsel and Nikola Bubalo. 2015. Benefiting from legacy bias. Interactions 22, 5: 44–47. https://doi.org/10.1145/2803169
[22]
Clemens Scott Kruse, Joanna Fohn, Gilson Umunnakwe, Krupa Patel, and Saloni Patel. 2020. Evaluating the Facilitators, Barriers, and Medical Outcomes Commensurate with the Use of Assistive Technology to Support People with Dementia: A Systematic Review Literature. Healthcare (Basel, Switzerland) 8, 3: 278. https://doi.org/10.3390/healthcare8030278
[23]
Haley M LaMonica, Amelia English, Ian B Hickie, Jerome Ip, Catriona Ireland, Stacey West, Tim Shaw, Loren Mowszowski, Nick Glozier, Shantel Duffy, Alice A Gibson, and Sharon L Naismith. 2017. Examining Internet and eHealth Practices and Preferences: Survey Study of Australian Older Adults With Subjective Memory Complaints, Mild Cognitive Impairment, or Dementia. Journal of Medical Internet Research 19, 10: e358. https://doi.org/10.2196/jmir.7981
[24]
Talia Lavie and Joachim Meyer. 2010. Benefits and costs of adaptive user interfaces. International Journal of Human-Computer Studies 68, 8: 508–524. https://doi.org/10.1016/j.ijhcs.2010.01.004
[25]
Amanda Lazar, Hilaire J. Thompson, and George Demiris. 2018. Design Recommendations for Recreational Systems Involving Older Adults Living With Dementia. Journal of Applied Gerontology 37, 5: 595–619. https://doi.org/10.1177/0733464816643880
[26]
Yao Ma, Jinjuan Heidi Feng, Libby Kumin, Jonathan Lazar, and Lakshmidevi Sreeramareddy. 2012. Investigating authentication methods used by individuals with down syndrome. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS ’12), 241–242. https://doi.org/10.1145/2384916.2384973
[27]
Yao Ma, Jinjuan Feng, Libby Kumin, and Jonathan Lazar. 2013. Investigating User Behavior for Authentication Methods: A Comparison between Individuals with Down Syndrome and Neurotypical Users. ACM Transactions on Accessible Computing 4, 4: 15:1-15:27. https://doi.org/10.1145/2493171.2493173
[28]
Jennifer Mankoff, Gillian R. Hayes, and Devva Kasnitz. 2010. Disability studies as a source of critical inquiry for the field of assistive technology. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility - ASSETS ’10, 3. https://doi.org/10.1145/1878803.1878807
[29]
Kimberly D. Mueller, Bruce Hermann, Jonilda Mecollari, and Lyn S. Turkstra. 2018. Connected speech and language in mild cognitive impairment and Alzheimer's disease: A review of picture description tasks. Journal of Clinical and Experimental Neuropsychology 40, 9: 917–939. https://doi.org/10.1080/13803395.2018.1446513
[30]
Maia Naftali and Leah Findlater. 2014. Accessibility in Context: Understanding the Truly MobileExperience of Smartphone Users with Motor Impairments. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility (ASSETS’14), 209–216. https://doi.org/10.1145/2661334.2661372
[31]
National Institute of Aging. 2021. Alzheimer's Disease Fact Sheet. National Institute on Aging. Retrieved October 11, 2021 from http://www.nia.nih.gov/health/alzheimers-disease-fact-sheet
[32]
P. Frazer Seymour, Justin Matejka, Geoff Foulds, Ihor Petelycky, and Fraser Anderson. 2017. AMI: An Adaptable Music Interface to Support the Varying Needs of People with Dementia. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility - ASSETS ’17, 150–154. https://doi.org/10.1145/3132525.3132557
[33]
Shenzhen UFO Technology Company. 2019. Simple Mode. Retrieved from https://play.google.com/store/apps/details?id=com.ape.easymode1&hl=en_US&gl=US
[34]
Julian Striegl, David Gollasch, Claudia Loitsch, and Gerhard Weber. 2021. Designing VUIs for Social Assistance Robots for People with Dementia. In Proceedings of Mensch und Computer 2021 (MuC ’21), 145–155. https://doi.org/10.1145/3473856.3473887
[35]
The Mayo Clinic Staff. 2022. When Alzheimer's symptoms start before age 65. Mayo Clinic. Retrieved January 19, 2024 from https://www.mayoclinic.org/diseases-conditions/alzheimers-disease/in-depth/alzheimers/art-20048356
[36]
Jayne Wallace, Anja Thieme, Gavin Wood, Guy Schofield, and Patrick Olivier. 2012. Enabling Self, Intimacy and a Sense of Home in Dementia: An Enquiry into Design in a Hospital Setting. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12), 2629–2638. https://doi.org/10.1145/2207676.2208654
[37]
Jacob O. Wobbrock, Shaun K. Kane, Krzysztof Z. Gajos, Susumu Harada, and Jon Froehlich. 2011. Ability-Based Design: Concept, Principles and Examples. ACM Transactions on Accessible Computing 3, 3: 9:1-9:27. https://doi.org/10.1145/1952383.1952384
[38]
Rachel Wood, Emma Dixon, Salma Elsayed-Ali, Ekta Shokeen, Amanda Lazar, and Jonathan Lazar. 2023. Exploring Future Personalization Opportunities in Technologies used by Older Adults with Mild to Moderate Dementia. In Proceedings of the 56th Hawaii International Conference on System Sciences. Retrieved January 10, 2023 from https://hdl.handle.net/10125/103129
[39]
Xingyi Zhou, Dequan Wang, and Philipp Krähenbühl. 2019. Objects as Points. https://doi.org/10.48550/arXiv.1904.07850
[40]
Simple Cell Phones for Seniors | Jitterbug Cell Phones | Lively. Retrieved October 13, 2022 from https://www.lively.com/phones/
[41]
Add Siri Shortcuts on iPhone. Apple Support. Retrieved October 13, 2022 from https://support.apple.com/guide/iphone/add-siri-shortcuts-iph7d118960c/ios
[42]
Create and manage Routines in the Google Home app - Android - Google Nest Help. Retrieved October 13, 2022 from https://support.google.com/googlenest/answer/7029585?hl=en&co=GENIE.Platform%3DAndroid
[43]
Google Assistant API | Google Assistant SDK. Google Developers. Retrieved October 13, 2022 from https://developers.google.com/assistant/sdk/reference/rpc
Index Terms
- Investigating the Potential of User Interface Shortcuts and Control Panes to Support Mobile Phone Use by People with Mild Dementia – a Diary Study
Recommendations
Mobile Phone Use by People with Mild to Moderate Dementia: Uncovering Challenges and Identifying Opportunities: Mobile Phone Use by People with Mild to Moderate Dementia
ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and AccessibilityWith the rising usage of mobile phones by people with mild dementia, and the documented barriers to technology use that exist for people with dementia, there is an open opportunity to study the specifics of mobile phone use by people with dementia. In ...
Usability evaluation of assistive technologies through qualitative research focusing on people with mild dementia
The assistive technologies (ATs) are commonly used for the wellbeing of people with dementia (PWD). Research shows that current ATs are not performing to their best and high rate of AT abandonment still exist. Although empirical evaluations greatly ...
Older People and the Use of Mobile Phones: An Interview Study
ACSAT '13: Proceedings of the 2013 International Conference on Advanced Computer Science Applications and TechnologiesAgeing populations are turning to technology in greater numbers than ever. New technology is being designed to help older people live independently for longer. Despite the usefulness of mobile phones especially older people, the current problems with ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
May 2024
4761 pages
ISBN:9798400703317
DOI:10.1145/3613905
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 May 2024
Check for updates
Qualifiers
- Work in progress
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 191Total Downloads
- Downloads (Last 12 months)191
- Downloads (Last 6 weeks)40
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format