More Web Proxy on the site http://driver.im/

abstract

GenAIR: Exploring Design Factor of Employing Generative AI for Augmented Reality

Authors:

Aaron QuigleyAuthors Info & Claims

SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction

Article No.: 47, Pages 1 - 3

https://doi.org/10.1145/3607822.3618018

Published: 13 October 2023 Publication History

Abstract

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial Intelligence-Generated Content (AIGC), including but not limited to images and text, is forging new paradigms for its application, particularly within the domain of Augmented Reality (AR). Nevertheless, the application of GenAI within the AR design process remains opaque. This paper aims to articulate a design space encapsulating a series of criteria and a prototypical process to aid practitioners in assessing the aptness of adopting pertinent technologies. The proposed model has been formulated based on a synthesis of design insights garnered from ten experts, obtained through focus group interviews. Leveraging these initial insights, we delineate potential applications of GenAI in AR.

References

[1]

Benjamin Bach, Ronell Sicat, Hanspeter Pfister, and Aaron Quigley. 2017. Drawing into the AR-CANVAS: Designing embedded visualizations for augmented reality. In Workshop on Immersive Analytics, IEEE Vis.

[2]

Zahraa Bassyouni and Imad H Elhajj. 2021. Augmented reality meets artificial intelligence in robotics: A systematic review. Frontiers in Robotics and AI (2021), 296.

[3]

Manuel Birlo, PJ Eddie Edwards, Matthew Clarkson, and Danail Stoyanov. 2022. Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review. Medical Image Analysis (2022), 102361.

[4]

Pei-Hsuan Chiu, Po-Hsuan Tseng, and Kai-Ten Feng. 2018. Interactive mobile augmented reality system for image and hand motion tracking. IEEE Transactions on Vehicular Technology 67, 10 (2018), 9995–10009.

[5]

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, 2022. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311 (2022).

[6]

Robert Dale. 2021. GPT-3: What’s it good for?Natural Language Engineering 27, 1 (2021), 113–118.

[7]

Luciano Floridi and Massimo Chiriatti. 2020. GPT-3: Its nature, scope, limits, and consequences. Minds and Machines 30, 4 (2020), 681–694.

Digital Library

[8]

Lorenzo Giunta, Jamie O’Hare, James Gopsill, Elies Dekoninck, 2018. A review of augmented reality research for design practice: looking to the future. DS 91: Proceedings of NordDesign 2018, Linköping, Sweden, 14th-17th August 2018 (2018).

[9]

Jeremy Hartmann, Yen-Ting Yeh, and Daniel Vogel. 2020. AAR: Augmenting a wearable augmented reality display with an actuated head-mounted projector. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 445–458.

Digital Library

[10]

Karen Henricksen and Jadwiga Indulska. 2006. Developing context-aware pervasive computing applications: Models and approach. Pervasive and mobile computing 2, 1 (2006), 37–64.

[11]

Allison Jing, Chenyang Xiang, Seungwon Kim, Mark Billinghurst, and Aaron Quigley. 2019. SnapChart: an augmented reality analytics toolkit to enhance interactivity in a collaborative environment. In The 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry. 1–2.

Digital Library

[12]

Timothy Jung and M Cluaudia tom Dieck. 2018. Augmented reality and virtual reality. Ujedinjeno Kraljevstvo: Springer International Publishing AG (2018).

[13]

Andreas Kotsios. 2015. Privacy in an augmented reality. International journal of law and information technology 23, 2 (2015), 157–185.

[14]

Gary Marcus, Ernest Davis, and Scott Aaronson. 2022. A very preliminary analysis of DALL-E 2. arXiv preprint arXiv:2204.13807 (2022).

[15]

Microsoft. 2019. HoloLens AR Glasses. https://www.microsoft.com/en-us/hololens/buy.

[16]

D Morgan. 1997. The focus group guidebook: sage publications.

[17]

Michael Nebeling and Maximilian Speicher. 2018. The trouble with augmented reality/virtual reality authoring tools. In 2018 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE, 333–337.

[18]

OnePlus. 2022. OnePlus 10 Pro Mobile Phone. https://www.oneplus.com/au/10-pro.

[19]

OpenAI. 2022. ChatGPT. https://openai.com/blog/chatgpt.

[20]

C Quin. 2022. Reviews-Consumer Technology. Gadgets: Acer Conceptd 7 Spatiallabs Edition, Kelda Bubblespa, Nothing Phone (1), Zhiyun Five Ray, Zuma Lumisonic, Samsung Freestyle. Engineering & Technology 17, 8 (2022), 102–108.

[21]

Jonathan Rafael-Patino, Gabriel Girard, Raphaël Truffet, Marco Pizzolato, Emmanuel Caruyer, and Jean-Philippe Thiran. 2021. The diffusion-simulated connectivity (DiSCo) dataset. Data in Brief 38 (2021), 107429.

[22]

Franziska Roesner, Tadayoshi Kohno, and David Molnar. 2014. Security and privacy for augmented reality systems. Commun. ACM 57, 4 (2014), 88–96.

Digital Library

[23]

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10684–10695.

[24]

Asangika Sandamini, Chamodi Jayathilaka, Thisara Pannala, Kasun Karunanayaka, Prabhash Kumarasinghe, and Dushani Perera. 2022. An Augmented Reality-based Fashion Design Interface with Artistic Contents Generated Using Deep Generative Models. In 2022 22nd International Conference on Advances in ICT for Emerging Regions (ICTer). IEEE, 104–109.

[25]

Heli K Väätäjä, Mari J Ahvenainen, Markus S Jaakola, and Thomas D Olsson. 2013. Exploring augmented reality for user-generated hyperlocal news content. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. 967–972.

[26]

Norha M Villegas, Cristian Sánchez, Javier Díaz-Cely, and Gabriel Tamura. 2018. Characterizing context-aware recommender systems: A systematic literature review. Knowledge-Based Systems 140 (2018), 173–200.

Digital Library

[27]

Peng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Xiangyu Zhang, Shuxia Wang, Weiping He, Yuxiang Yan, and Hongyu Ji. 2021. AR/MR remote collaboration on physical tasks: A review. Robotics and Computer-Integrated Manufacturing 72 (2021), 102071.

Digital Library

[28]

Xingzhi Wang, Ang Liu, and Sami Kara. 2022. Constructing Product Usage Context Knowledge Graph Using User-Generated Content for User-Driven Customization. Journal of Mechanical Design (2022), 1–48.

[29]

Maheshya Weerasinghe, Aaron Quigley, Klen Čopič Pucihar, Alice Toniolo, Angela Miguel, and Matjaž Kljun. 2022. Arigatō: Effects of Adaptive Guidance on Engagement and Performance in Augmented Reality Learning Environments. IEEE Transactions on Visualization and Computer Graphics 28, 11 (2022), 3737–3747.

[30]

Minrui Xu, Dusit Niyato, Hongliang Zhang, Jiawen Kang, Zehui Xiong, Shiwen Mao, and Zhu Han. 2023. Generative AI-empowered Effective Physical-Virtual Synchronization in the Vehicular Metaverse. arXiv preprint arXiv:2301.07636 (2023).

Cited By

Hu YHu WQuigley A(2024)Towards Enhanced Context Awareness with Vision-based Multimodal InterfacesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686646(1-3)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686646
Hu YZheng DNie KZhang JHu WQuigley A(2024)Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00124(427-428)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00124
Ren XWang NPan JBu L(2024)Combining style generative adversarial networks with particle swarm optimisation-support vector regression to design affective social robot for public health interventionJournal of Engineering Design10.1080/09544828.2024.241583036:1(160-190)Online publication date: 17-Oct-2024
https://doi.org/10.1080/09544828.2024.2415830
Show More Cited By

Index Terms

GenAIR: Exploring Design Factor of Employing Generative AI for Augmented Reality

Index terms have been assigned to the content through auto-classification.

Recommendations

XR and AI: AI-Enabled Virtual, Augmented, and Mixed Reality
UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

This workshop aims to unite experts and practitioners in XR and AI to envision the future of AI-enabled virtual, augmented, and mixed reality experiences. Our expansive discussion includes a variety of key topics: Generative XR, Large Language Models (...
reFrame: An Alternate Paradigm for Augmented Reality
SIGGRAPH '20: ACM SIGGRAPH 2020 Posters

“reFrame” is an optically see-through Augmented Reality (AR) platform capable of displaying parallax-free images superimposed over physical objects and the scenery behind it. It uses head-tracking technology and off-axis perspective projection to ...
Through the Realities of Augmented Reality
HCI International 2019 – Late Breaking Papers
Abstract
Speaking of Augmented Reality (AR), it is about augmenting an actual world with some virtually generated digital information in order to make the combination of two worlds as seamless as possible. Creating seamless AR effects in real time is non-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction

October 2023

505 pages

ISBN:9798400702815

DOI:10.1145/3607822

Editors:
Tony Huang
UTS, Sydney, Australia
,
Misha Sra
UC Santa Barbara, USA
,
Ferran Argelaguet
INRIA, France
,
Pedro Lopes
University of Chicago, USA
,
Mayra Barrera Machuca
Dalhousie University, Canada

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2023

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

SUI '23

Sponsor:

SUI '23: ACM Symposium on Spatial User Interaction

October 13 - 15, 2023

NSW, Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
383
Total Downloads

Downloads (Last 12 months)198
Downloads (Last 6 weeks)8

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hu YHu WQuigley A(2024)Towards Enhanced Context Awareness with Vision-based Multimodal InterfacesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686646(1-3)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3686646
Hu YZheng DNie KZhang JHu WQuigley A(2024)Exploring Device-Oriented Video Encryption for Hierarchical Privacy Protection in AR Content Sharing2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct64951.2024.00124(427-428)Online publication date: 21-Oct-2024
https://doi.org/10.1109/ISMAR-Adjunct64951.2024.00124
Ren XWang NPan JBu L(2024)Combining style generative adversarial networks with particle swarm optimisation-support vector regression to design affective social robot for public health interventionJournal of Engineering Design10.1080/09544828.2024.241583036:1(160-190)Online publication date: 17-Oct-2024
https://doi.org/10.1080/09544828.2024.2415830
Huang Z(2024)Adaptive interior design method for different MBTI personality types based on generative artificial intelligenceArchitectural Intelligence10.1007/s44223-024-00066-z3:1Online publication date: 1-Jul-2024
https://doi.org/10.1007/s44223-024-00066-z
Rücker KLivada ČGalba TBaumgartner A(2024)Using Stable Diffusion Model for Text-Driven Generation in Augmented Reality Applications33rd International Conference on Organization and Technology of Maintenance (OTO 2024)10.1007/978-3-031-80597-4_11(135-153)Online publication date: 31-Dec-2024
https://doi.org/10.1007/978-3-031-80597-4_11
Hu YHu WQuigley A(2023)Towards Using Generative AI for Facilitating Image Creation in Spatial Augmented Reality2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00095(441-443)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00095

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten