More Web Proxy on the site http://driver.im/

research-article

Open access

Virtuality or Physicality? Supporting Memorization Through Augmented Reality Gamification

Authors:

Andrzej Romanowski,

Morten FjeldAuthors Info & Claims

EICS '23 Companion: Companion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems

Pages 53 - 58

https://doi.org/10.1145/3596454.3597183

Published: 27 June 2023 Publication History

All formats PDF

Abstract

Augmented reality (AR) is evolving to become a pervasive tool for interacting with virtual objects. We conducted a comparative study to explore the impact of virtuality and physicality in supporting human memorization through gamification. A head-mounted display (HMD) AR memory matching game and a corresponding physical version game with paper boards were harnessed. The proof-of-concept version was demonstrated in an initial user study (n=12) with counterbalancing design to determine that our proposed gamified HMD AR system with virtuality could support better human memorization compared to the physical version game in reducing task time, improving usability, becoming more recommendable, and decreasing cognitive task workload. The study was then followed by quantitative analysis of the respective four metrics: game completion time (GCT), system usability scale (SUS), recommendation level, and NASA task load index (TLX). A brief qualitative analysis is presented. The results show that in our case, the virtuality outperformed the physicality in supporting human memorization in a gamified context through HMD AR in an evident range.

References

[1]

H Ahmad, NMM Zainuddin, R Ali, N Maarop, RCM Yusoff, and WAW Hassan. 2018. Augmented reality to memorize Al-Quran for hearing impaired students: a preliminary analysis. Journal of Fundamental and Applied Sciences 10, 2S (2018), 91–102.

[2]

Ronald T Azuma. 1997. A survey of augmented reality. Presence: teleoperators & virtual environments 6, 4 (1997), 355–385.

[3]

Mark Billinghurst. 2002. Augmented reality in education. New horizons for learning 12, 5 (2002), 1–5.

[4]

Matt Bower, Cathie Howe, Nerida McCredie, Austin Robinson, and David Grover. 2014. Augmented Reality in education–cases, places and potentials. Educational Media International 51, 1 (2014), 1–15.

[5]

Pedro Quelhas Brito and Jasmina Stoyanova. 2018. Marker versus markerless augmented reality. Which has more impact on users?International Journal of Human–Computer Interaction 34, 9 (2018), 819–833.

[6]

John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.

[7]

Fabio Bruno, Francesco Caruso, Luigi De Napoli, and Maurizio Muzzupappa. 2006. Visualization of industrial engineering data visualization of industrial engineering data in augmented reality. Journal of visualization 9, 3 (2006), 319–329.

Digital Library

[8]

Jayfus T Doswell and Anna Skinner. 2014. Augmenting human cognition with adaptive augmented reality. In International Conference on Augmented Cognition. Springer, 104–113.

Digital Library

[9]

Shubham Gargrish, Deepti P Kaur, Archana Mantri, Gurjinder Singh, and Bhanu Sharma. 2021. Measuring effectiveness of augmented reality-based geometry learning assistant on memory retention abilities of the students in 3D geometry. Computer Applications in Engineering Education 29, 6 (2021), 1811–1824.

[10]

Jens Grubert, Tobias Langlotz, Stefanie Zollmann, and Holger Regenbrecht. 2016. Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics 23, 6 (2016), 1706–1724.

[11]

Esteban Guerrero, Ming-Hsin Lu, Hsiu-Ping Yueh, and Helena Lindgren. 2019. Designing and evaluating an intelligent augmented reality system for assisting older adults’ medication management. Cognitive Systems Research 58 (2019), 278–291.

Digital Library

[12]

Ramy Hammady, Minhua Ma, and Nicholas Temple. 2016. Augmented reality and gamification in heritage museums. In Joint International Conference on Serious Games. Springer, 181–187.

[13]

Kyungjin Han, Kiho Park, Kee-Hong Choi, and Jongweon Lee. 2021. Mobile augmented reality serious game for improving old adults’ working memory. Applied Sciences 11, 17 (2021), 7843.

[14]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.

[15]

Zheng-Yu Hoe, I-Jui Lee, Chien-Hsu Chen, and Kuo-Ping Chang. 2019. Using an augmented reality-based training system to promote spatial visualization ability for the elderly. Universal Access in the Information Society 18, 2 (2019), 327–342.

Digital Library

[16]

Enamul Hoque. 2018. Memorization: a proven method of learning. International Journal of Applied Research 22, 3 (2018), 142–150.

[17]

Lei Hou and Xiangyu Wang. 2013. A study on the benefits of augmented reality in retaining working memory in assembly tasks: A focus on differences in gender. Automation in Construction 32 (2013), 38–45.

[18]

Marinos Ioannides, Nadia Magnenat-Thalmann, and George Papagiannakis. 2017. Mixed reality and gamification for cultural heritage. Vol. 2. Springer.

[19]

Kiyoshi Kiyokawa. 2012. Trends and vision of head mounted display in augmented reality. In 2012 International Symposium on Ubiquitous Virtual Reality. IEEE, 14–17.

Digital Library

[20]

Kangdon Lee. 2012. Augmented reality in education and training. TechTrends 56, 2 (2012), 13–21.

[21]

Mario Lorenz, Sebastian Knopp, and Philipp Klimant. 2018. Industrial augmented reality: Requirements for an augmented reality maintenance worker support system. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 151–153.

[22]

Peter Mesáro, Tomá Mandičák, Manuel Ferrer Hernandez, Csaba Sido, Mário Molokáč, Ladislav Hvizdák, Radoslav Delina, 2016. Use of Augmented Reality and Gamification techniques in tourism.E-review of Tourism Research 2 (2016).

[23]

Francisco Munoz-Montoya, Camino Fidalgo, M-Carmen Juan, and Magdalena Mendez-Lopez. 2019. Memory for object location in augmented reality: The role of gender and the relationship among spatial and anxiety outcomes. Frontiers in Human Neuroscience 13 (2019), 113.

[24]

Francisco Munoz-Montoya, M-Carmen Juan, Magdalena Mendez-Lopez, and Camino Fidalgo. 2018. Augmented reality based on SLAM to assess spatial short-term memory. IEEE Access 7 (2018), 2453–2466.

[25]

Adam Nowak, Yuchong Zhang, Andrzej Romanowski, and Morten Fjeld. 2021. Augmented Reality with Industrial Process Tomography: To Support Complex Data Analysis in 3D Space. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. 56–58.

Digital Library

[26]

Oscar Rosello, Marc Exposito, and Pattie Maes. 2016. Nevermind: Using augmented reality for memorization. In Proceedings of the 29th annual symposium on user interface software and technology. 215–216.

Digital Library

[27]

Lorraine Scanlon, Emma O’Shea, Rónán O’Caoimh, and Suzanne Timmons. 2016. Usability and validity of a battery of computerised cognitive screening tests for detecting cognitive impairment. Gerontology 62, 2 (2016), 247–252.

[28]

Tobias Sielhorst, Marco Feuerstein, and Nassir Navab. 2008. Advanced medical displays: A literature review of augmented reality. Journal of Display Technology 4, 4 (2008), 451–467.

[29]

Pete Willemsen, William Jaros, Charles McGregor, Edward Downs, Maranda Berndt, and Alexander Passofaro. 2018. Memory task performance across augmented and virtual reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 723–724.

[30]

Bo Zhang, Nigel Robb, 2021. Immersion Experiences in a Tablet-Based Markerless Augmented Reality Working Memory Game: Randomized Controlled Trial and User Experience Study. JMIR serious games 9, 4 (2021), e27036.

[31]

Yuchong Zhang, Adam Nowak, Guruprasad Rao, Andrzej Romanowski, and Morten Fjeld. 2023, in press. Is Industrial Tomography Ready for Augmented Reality? A Need-finding Study of How Augmented Reality Can Be Adopted by Industrial Tomography Experts. In International Conference on Human-Computer Interaction. Springer.

[32]

Yuchong Zhang, Adam Nowak, Andrzej Romanowski, and Morten Fjeld. 2022. An Initial Exploration of Visual Cues in Head-Mounted Display Augmented Reality for Book Searching. In Proceedings of the 21st International Conference on Mobile and Ubiquitous Multimedia. 273–275.

Digital Library

[33]

Yuchong Zhang, Adam Nowak, Andrzej Romanowski, and Morten Fjeld. 2022. On-site or Remote Working?: An Initial Solution on How COVID-19 Pandemic May Impact Augmented Reality Users. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces. 1–3.

Digital Library

[34]

Yuchong Zhang, Adam Nowak, Yueming Xuan, Andrzej Romanowski, and Morten Fjeld. 2023. See or Hear? Exploring the Effect of Visual and Audio Hints and Gaze-assisted Task Feedback for Visual Search Tasks in Augmented Reality. arXiv preprint arXiv:2302.01690 (2023).

[35]

Yuchong Zhang, Adel Omrani, Rahul Yadav, and Morten Fjeld. 2021. Supporting Visualization Analysis in Industrial Process Tomography by Using Augmented Reality—A Case Study of an Industrial Microwave Drying System. Sensors 21, 19 (2021), 6515.

[36]

Yuchong Zhang, Rahul Yadav, Adel Omrani, and Morten Fjeld. 2021. A Novel Augmented Reality System To Support Volumetric Visualization in Industrial Process Tomography. In Proceedings of the 2021 Conference on Interfaces and Human Computer Interaction. 3–9.

Cited By

Zhang YMa YKragic D(2024)Vision Beyond Boundaries: An Initial Design Space of Domain-specific Large Vision Models in Human-robot InteractionAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680244(1-8)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680244
Zhang YNowak AXuan YRomanowski AFjeld M(2023)See or Hear? Exploring the Effect of Visual/Audio Hints and Gaze-assisted Instant Post-task Feedback for Visual Search Tasks in AR2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00128(1113-1122)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00128

Index Terms

Virtuality or Physicality? Supporting Memorization Through Augmented Reality Gamification
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
      2. User studies
    2. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2

An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Augmented reality as perceptual reality
VSMM'06: Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems

As shown in Paul Milgram et al’s Reality-Virtuality Continuum (1994), Augmented Reality occupies a very unique status in the spectrum of Mixed Reality. Unlike Virtual Reality, which is completely made up of the virtual and has been the most important ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EICS '23 Companion: Companion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 2023

104 pages

ISBN:9798400702068

DOI:10.1145/3596454

Editors:
Alan Dix
Swansea University, United Kingdom
,
Marco Winckler
Université Cote d’Azur, France
,
Matt Jones
Swansea University, United Kingdom

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 June 2023

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

EICS '23

Sponsor:

SIGCHI

EICS '23: The 15th ACM SIGCHI Symposium on Engineering Interactive Computing Systems

June 27 - 30, 2023

Swansea, United Kingdom

Acceptance Rates

Overall Acceptance Rate 73 of 299 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
384
Total Downloads

Downloads (Last 12 months)256
Downloads (Last 6 weeks)29

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang YMa YKragic D(2024)Vision Beyond Boundaries: An Initial Design Space of Domain-specific Large Vision Models in Human-robot InteractionAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680244(1-8)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680244
Zhang YNowak AXuan YRomanowski AFjeld M(2023)See or Hear? Exploring the Effect of Visual/Audio Hints and Gaze-assisted Instant Post-task Feedback for Visual Search Tasks in AR2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00128(1113-1122)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00128

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents