More Web Proxy on the site http://driver.im/

Article

“Is This Real?”: Assessing the Usability and Accessibility of Augmented Reality with People with Intellectual Disabilities

Authors:

Leandro S. Guedes,

Marilina Mastrogiuseppe,

Monica LandoniAuthors Info & Claims

Universal Access in Human-Computer Interaction: 17th International Conference, UAHCI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part II

Pages 91 - 110

https://doi.org/10.1007/978-3-031-35897-5_7

Published: 23 July 2023 Publication History

Abstract

This paper assesses the perception of Augmented Reality (AR) by People with Intellectual Disabilities (IDs) when using assistive technologies in preparation for a museum visit. We designed and developed an application to test how AR can provide support and is perceived in this context. We organized a user study with 20 participants with IDs, all members of the same association. Three research visits, including focus groups, enabled us to assess the memorability of the contents before introducing AR technology and collect information about users’ habits and preferences. Later, we assessed users’ perception of AR individually during a test session and conducted a task-oriented hands-on session. Finally, we went to the museum with our users and gathered information about their preferences and choices when using AR in situ, constantly analyzing verbal and non-verbal feedback. We describe all our findings and discuss their implications in terms of guidelines for future design.

References

[1]

Ahmetovic, D., Bernareggi, C., Keller, K., Mascetti, S.: Musa: Artwork accessibility through augmented reality for people with low vision. In: Proceedings of the 18th International Web for All Conference. W4A ’21, Association for Computing Machinery, New York, NY, USA (2021)., https://doi.org/10.1145/3430263.3452441

[2]

Akçayır M and Akçayır G Advantages and challenges associated with augmented reality for education: a systematic review of the literature Educ. Res. Rev. 2017 20 1-11

[3]

Al-Megren S and Almutairi A Rau P-LP Assessing the effectiveness of an augmented reality application for the literacy development of arabic children with hearing impairments Cross-Cultural Design. Applications in Cultural Heritage, Creativity and Social Development 2018 Cham Springer 3-18

[4]

American Psychiatric Association, A., Association, A.P., et al.: Diagnostic and statistical manual of mental disorders: DSM-5, vol. 10. Washington, DC: American psychiatric association (2013)

[5]

Bai Z, Blackwell AF, and Coulouris G Using augmented reality to elicit pretend play for children with autism IEEE Trans. Visual Comput. Graphics 2014 21 5 598-610

[6]

Baragash RS, Al-Samarraie H, Alzahrani AI, and Alfarraj O Augmented reality in special education: a meta-analysis of single-subject design studies Eur. J. Spec. Needs Educ. 2020 35 3 382-397

[7]

Barbosa, P., Amorim, P., Leal Ferreira, S.B.: Augmented reality and museum accessibility: A case study to support hard of hearing people. Association for Computing Machinery, New York, NY, USA (2019),

[8]

Beukelman DR, Mirenda P, et al. Augmentative and Alternative Communication 1998 Brookes Baltimore Paul H

[9]

Bircanin, F., Brereton, M., Sitbon, L., Ploderer, B., Azaabanye Bayor, A., Koplick, S.: Including adults with severe intellectual disabilities in co-design through active support. Association for Computing Machinery, New York, NY, USA (2021),

[10]

Bridges SA, Robinson OP, Stewart EW, Kwon D, and Mutua K Augmented reality: teaching daily living skills to adults with intellectual disabilities J. Spec. Educ. Technol. 2020 35 1 3-14

[11]

Bruno LP, Lewis AM, Kaldenberg ER, Bahr PA, and Immerfall J Direct instruction of text-to-speech software for students with intellectual disability Educ. Train. Autism Develop. Disabilities 2020 55 4 424-437

[12]

Cakir R and Korkmaz O The effectiveness of augmented reality environments on individuals with special education needs Educ. Inf. Technol. 2019 24 1631-1659

[13]

Callanan M, Cervantes C, and Loomis M Informal learning Wiley Interdiscip. Rev.: Cogn. Sci. 2011 2 6 646-655

[14]

Carrizosa HG, Sheehy K, Rix J, Seale J, and Hayhoe S Designing technologies for museums: accessibility and participation issues J. Enabl. Technol. 2020 14 1 31-39

[15]

Cascales-Martínez A, Martínez-Segura MJ, Pérez-López D, and Contero M Using an augmented reality enhanced tabletop system to promote learning of mathematics: a case study with students with special educational needs Eurasia J. Math., Sci. Technol. Educ. 2016 13 2 355-380

[16]

Chang YL, Hou HT, Pan CY, Sung YT, and Chang KE Apply an augmented reality in a mobile guidance to increase sense of place for heritage places J. Educ. Technol. Society 2015 18 2 166-178

[17]

Colin Gibson, R., D. Dunlop, M., Bouamrane, M.M.: Lessons from expert focus groups on how to better support adults with mild intellectual disabilities to engage in co-design. Association for Computing Machinery, New York, NY, USA (2020),

[18]

Dermitzaki I, Stavroussi P, Bandi M, and Nisiotou I Investigating ongoing strategic behaviour of students with mild mental retardation: implementation and relations to performance in a problem-solving situation Eval. Res. Educ. 2008 21 2 96-110

[19]

Fajardo I, Ávila V, Ferrer A, Tavares G, Gómez M, and Hernández A Easy-to-read texts for students with intellectual disability: linguistic factors affecting comprehension J. Appl. Res. Intellect. Disabil. 2014 27 3 212-225

[20]

Falk, J.H., Moussouri, T., Coulson, D.: The effect of visitors ‘agendas on museum learning. Curator: Museum J. 41(2), 107–120 (1998)

[21]

Franchi, F., Graziosi, F., Rinaldi, C., Tarquini, F.: Aal solutions toward cultural heritage enjoyment. In: 2016 IEEE 27th Annual International Symposium On Personal, Indoor, And Mobile Radio Communications (PIMRC), pp. 1–6. IEEE (2016)

[22]

Garzón J, Baldiris S, Gutiérrez J, Pavón J, et al. How do pedagogical approaches affect the impact of augmented reality on education? a meta-analysis and research synthesis Educ. Res. Rev. 2020 31

[23]

Garzón J, Pavón J, and Baldiris S Systematic review and meta-analysis of augmented reality in educational settings Virtual Real. 2019 23 4 447-459

[24]

Guay, F., Ratelle, C.F., Chanal, J.: Optimal learning in optimal contexts: the role of self-determination in education. Can. Psychol. 49(3), 233 (2008)

[25]

Guedes LS, Marques LA, and Vitório G Miesenberger K, Manduchi R, Covarrubias Rodriguez M, and Peňáz P Enhancing interaction and accessibility in museums and exhibitions with augmented reality and screen readers Computers Helping People with Special Needs 2020 Cham Springer International Publishing 157-163

[26]

Ibáñez MB, Di Serio Á, Villarán D, and Kloos CD Experimenting with electromagnetism using augmented reality: impact on flow student experience and educational effectiveness Comput. Educ. 2014 71 1-13

[27]

Jdaitawi, M.T., Kan’an, A.F.: A decade of research on the effectiveness of augmented reality on students with special disability in higher education. Contemp. Educ. Technol. 14(1) (2022)

[28]

Kang YS and Chang YJ Using an augmented reality game to teach three junior high school students with intellectual disabilities to improve atm use J. Appl. Res. Intellect. Disabil. 2020 33 3 409-419

[29]

Kauffman, J.M., Hallahan, D.P., Pullen, P.C., Badar, J.: Special education: What it is and why we need it. Routledge (2018)

[30]

Kellems RO, Cacciatore G, and Osborne K Using an augmented reality-based teaching strategy to teach mathematics to secondary students with disabilities Career Dev. Transit. Except. Individ. 2019 42 4 253-258

[31]

King, B., Lord, B.: The manual of museum learning. Rowman & Littlefield (2015)

[32]

McMahon DD, Cihak DF, Wright RE, and Bell SM Augmented reality for teaching science vocabulary to postsecondary education students with intellectual disabilities and autism J. Res. Technol. Educ. 2016 48 1 38-56

[33]

Navarro Delgado, I., Fonseca, D.: Implementation of methodological processes of users experience with 3d and augmented reality. case study with students of architecture and users with disablities (2011)

[34]

Nomura, M., Skat Nielsen, G., Tronbacke, B.: Guidelines for easy-to-read materials. International Federation of Library Associations and Institutions (IFLA) (2010)

[35]

Patel DR, Apple R, Kanungo S, and Akkal A Intellectual disability: definitions, evaluation and principles of treatment Pediatric Med. 2018 1 11 10-21037

[36]

Rappolt-Schlichtmann, G., Daley, S.G.: Providing access to engagement in learning: The potential of universal design for learning in museum design. Curator: The Museum J. 56(3), 307–321 (2013)

[37]

Reichinger A, Fuhrmann A, Maierhofer S, and Purgathofer W Miesenberger K, Bühler C, and Penaz P A concept for re-useable interactive tactile reliefs Computers Helping People with Special Needs 2016 Cham Springer 108-115

[38]

Richard, E., Billaudeau, V., Richard, P., Gaudin, G.: Augmented reality for rehabilitation of cognitive disabled children: A preliminary study. In: 2007 virtual rehabilitation, pp. 102–108. IEEE (2007)

[39]

Salah J, Abdennadher S, and Atef S Alcañiz M, Göbel S, Ma M, Fradinho Oliveira M, Baalsrud Hauge J, and Marsh T Galaxy shop: projection-based numeracy game for teenagers with down syndrome Serious Games 2017 Cham Springer 109-120

[40]

Sandell R Museums as agents of social inclusion Museum Manage. Curatorship 1998 17 4 401-418

[41]

Sayed N, Zayed HH, and Sharawy MI Arsc: augmented reality student card an augmented reality solution for the education field Comput. Educ. 2011 56 4 1045-1061

[42]

Seale, J., Chadwick, D.: How does risk mediate the ability of adolescents and adults with intellectual and developmental disabilities to live a normal life by using the internet? Cyberpsychology: J. Psychosoc. Res. Cyberspace 11(1) (2017)

[43]

Sheehy, K., Garcia Carrizosa, H., Rix, J., Seale, J., Hayhoe, S.: Inclusive museums and augmented reality. affordances, participation, ethics and fun. Int. J. Inclusive Museum 12(4), 67–85 (2019)

[44]

Sitbon, L., Farhin, S.: Co-designing interactive applications with adults with intellectual disability: A case study. Association for Computing Machinery, New York, NY, USA (2017).

[45]

Soares Guedes, L.: Designing multisensory experiences for users with different reading abilities visiting a museum (129) (2021).

[46]

Soares Guedes L, Ferrari V, Mastrogiuseppe M, Span S, and Landoni M Miesenberger K, Kouroupetroglou G, Mavrou K, Manduchi R, Covarrubias Rodriguez M, and Penáz P Access+: designing a museum application for people with intellectual disabilities Computers Helping People with Special Needs 2022 Cham Springer International Publishing 425-431

[47]

Sotiriou S and Bogner FX Visualizing the invisible: augmented reality as an innovative science education scheme Adv. Sci. Lett. 2008 1 1 114-122

[48]

Spaulding LS and Pratt SM A review and analysis of the history of special education and disability advocacy in the united states Am. Educ. History J. 2015 42 1/2 91

[49]

Stanco F, Tanasi D, Allegra D, Milotta FLM, Lamagna G, and Monterosso G Virtual anastylosis of greek sculpture as museum policy for public outreach and cognitive accessibility J. Electron. Imaging 2017 26 1 011025-011025

[50]

W3C: Web content accessibility guidelines (2023), https://www.w3.org/WAI/standards-guidelines/wcag/ = "February 5, 2023"

[51]

Wehmeyer, M.L., Shogren, K.A.: Self-determination and choice. Handbook Of Evidence-based Practices in Intellectual And Developmental Disabilities, pp. 561–584 (2016)

[52]

Zhao, Y., Szpiro, S., Knighten, J., Azenkot, S.: Cuesee: exploring visual cues for people with low vision to facilitate a visual search task. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 73–84 (2016)

Cited By

Guedes LJohnstone JEllis KLandoni M(2024)Creative Technologies in Action: Empowering Individuals with Intellectual DisabilitiesComputers Helping People with Special Needs10.1007/978-3-031-62849-8_24(193-200)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-62849-8_24

Recommendations

Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Inclusive Immersion: a review of efforts to improve accessibility in virtual reality, augmented reality and the metaverse
Abstract
Virtual Reality (VR) and Augmented Reality (AR) afford new forms of work and leisure. While affordable and effective VR and AR headsets are now available, neither technology has achieved widespread user adoption. However, we predict continual ...
Understanding Job Coaches’ Perspectives on Using Virtual Reality as a Job Training Tool for Training People with Intellectual Disabilities
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

This study aimed to investigate the potential of virtual reality (VR) as a training tool for job coaches working with people with intellectual disabilities (ID). In this work, we conducted a qualitative study with job coaches of people with ID that ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

Universal Access in Human-Computer Interaction: 17th International Conference, UAHCI 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part II

Jul 2023

654 pages

ISBN:978-3-031-35896-8

DOI:10.1007/978-3-031-35897-5

Editors:
Margherita Antona
Foundation for Research and Technology, Heraklion, Crete, Greece
,
Constantine Stephanidis
Foundation for Research and Technology, Heraklion, Crete, Greece

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2023.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 23 July 2023

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Guedes LJohnstone JEllis KLandoni M(2024)Creative Technologies in Action: Empowering Individuals with Intellectual DisabilitiesComputers Helping People with Special Needs10.1007/978-3-031-62849-8_24(193-200)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1007/978-3-031-62849-8_24

View Options

View options

Media

Figures

Other

Tables

View Table of Contents