Extended Reality Authoring System for Creating Immersive Experiences: A Requirements Analysis
Article No.: 20, Pages 1 - 9
Abstract
This paper discusses the challenges and complex processes related to creating content for Extended Reality applications. More specifically, the paper focuses on the challenges and processes involved in developing mixed reality applications using the Unity engine and the Microsoft HoloLens 2 device. To design and develop immersive Extended Reality experiences, specific skills and knowledge of tools and their interfaces and compatibility are required. The proposed concept could considerably improve the efficiency and effectiveness of XR development by facilitating cross-device collaboration and design. This could be beneficial for creating immersive experiences, such as content-driven art projects, for devices like the HoloLens.
References
[1]
Adobe. 30.06.2022. Adobe Aero. https://www.adobe.com/products/aero.html
[2]
Narges Ashtari, Andrea Bunt, Joanna McGrenere, Michael Nebeling, and Parmit K. Chilana. 2020. Creating Augmented and Virtual Reality Applications: Current Practices, Challenges, and Opportunities. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Regina Bernhaupt, Florian ’Floyd’ Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjørn, Shengdong Zhao, Briane Paul Samson, and Rafal Kocielnik (Eds.). ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376722
[3]
Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. 2001. The MagicBook: a transitional AR interface. Computers & Graphics 25, 5 (2001), 745–753. https://doi.org/10.1016/S0097-8493(01)00117-0 https://doi.org/10.1016/S0097-8493(01)00117-0
[4]
Felipe G. Carvalho, Daniela G. Trevisan, and Alberto Raposo. 2012. Toward the design of transitional interfaces: an exploratory study on a semi-immersive hybrid user interface. Virtual Reality 16, 4 (2012), 271–288. https://doi.org/10.1007/s10055-011-0205-y
[5]
/s10055-011-0205-y
[6]
Deutsche Akkreditierungsstelle. 2010. Leitfaden Usability. https://www.dakks. de/
[7]
Inc Epic Games. 20.07.23. Unreal Editor VR Mode. https://docs.unrealengine. com/5.0/en-US/vr-mode-in-unreal-editor/
[8]
ExtendRealityLtd. 02.04.22. VRTK - Virtual Reality Toolkit. https://www.vrtk.io/ [8] GitHub. 25.05.2022. Unity-Technologies/EditorXR: Author XR in XR. https: //github.com/Unity-Technologies/EditorXR
[9]
R. Holm, E. Stauder, R. Wagner, M. Priglinger, and J. Volkert. 2002. A combined immersive and desktop authoring tool for virtual environments. In Proceedings IEEE Virtual Reality 2002. IEEE Comput. Soc, Orlando, FL, USA, 93–100. https:.https://doi.org/10.1109/VR.2002.996511
[10]
Christoph Holtmann, Johann Habakuk Israel, and Thomas Jung. 2022. Cross Reality Authoring: A Mixed Reality Editor approach. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, Singapore, Singapore, 923–926. https://doi.org/10.1109/ISMAR-Adjunct57072.2022.00206 2022.00206
[11]
Seungyeon Huh, Shapna Muralidharan, Heedong Ko, and Byounghyun Yoo. 2019. XR Collaboration Architecture based on Decentralized Web. In The 24th International Conference on 3D Web Technology, Nicholas F. Polys, Mike McCann, Feng Liu, and Andreas Plesch (Eds.). ACM, New York, NY, USA, 1–9. https://doi.org/10.1145/3329714.3338137 https://doi.org/10.1145/3329714.3338137
[12]
Pamela Jennings. 2004. Reflections on interdisciplinary team development for the design of a platform for computer supported collaborative play. Digital Creativity 15, 4 (2004), 209–222. https://doi.org/10.1080/1462626048520182
[13]
Kangsoo Kim, Mark Billinghurst, Gerd Bruder, Henry Been-Lirn Duh, and Gregory F. Welch. 2018. Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008-2017). IEEE Transactions on Visualization and Computer Graphics 24, 11 (2018), 2947–2962. https://doi.org/10.1109/TVCG.2018.2868591 2868591
[14]
Veronika Krauß, Florian Jasche, Sheree May Saßmannshausen, Thomas Ludwig, and Alexander Boden. 2021. Research and Practice Recommendations for Mixed Reality Design – Different Perspectives from the Community. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology, Yuichi Itoh, Kazuki Takashima, Parinya Punpongsanon, Misha Sra, Kazuyuki Fujita, Shigeo Yoshida, and Tham Piumsomboon (Eds.). ACM, New York, NY, USA, 1–13. https://doi.org/10.1145/3489849.3489876
[15]
Veronika Krauß, Michael Nebeling, Florian Jasche, and Alexander Boden. 2022. Elements of XR Prototyping: Characterizing the Role and Use of Prototypes in Augmented and Virtual Reality Design. In CHI Conference on Human Factors in Computing Systems, Simone Barbosa, Cliff Lampe, Caroline Appert, David A. Shamma, Steven Drucker, Julie Williamson, and Koji Yatani (Eds.). ACM, New York, NY, USA, 1–18. https://doi.org/10.1145/3491102.3517714
[16]
Microsoft. 2023. Mixed Reality Toolkit 3 Developer Documentation -MRTK3. https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/ mrtk3-overview/
[17]
Microsoft. 30.06.2022. Microsoft Maquette Beta overview - Mixed Reality. https: //docs.microsoft.com/en-us/windows/mixed-reality/design/maquette
[18]
Michael Nebeling, Katy Lewis, Yu-Cheng Chang, Lihan Zhu, Michelle Chung, Piaoyang Wang, and Janet Nebeling. 2020. XRDirector: A Role-Based Collaborative Immersive Authoring System. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Regina Bernhaupt, Florian ’Floyd’ Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjørn, Shengdong Zhao, Briane Paul Samson, and Rafal Kocielnik (Eds.). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376637 https://doi.org/10.1145/3313831.3376637
[19]
Overlay. 2022. Figmin. https://www.figmin.com/
[20]
Overlay. 2022. Figmin XR - Microsoft Store. https://www.microsoft.com/enus/p/figmin-xr/9nb9714m2kc4
[21]
Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner Garden. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, Gloria Mark, Susan Fussell, Cliff Lampe, m.c. schraefel, Juan Pablo Hourcade, Caroline Appert, and Daniel Wigdor (Eds.). ACM, New York, NY, USA, 1459–1470. https://doi.org/10.1145/3025453.3025743
[22]
Joan Sol Roo and Martin Hachet. 2017. One Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, Krzysztof Gajos, Jennifer Mankoff, and Chris Harrison (Eds.). ACM, New York, NY, USA, 787–795.https://doi.org/10.1145/3126594.3126638
[23]
C. Sandor, A. Olwal, B. Bell, and S. Feiner. 2005. Immersive mixed-reality configuration of hybrid user interfaces. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’05). IEEE, Vienna, Austria, 110–113. https://doi.org/10.1109/ISMAR.2005.37
[24]
Mickael Sereno, Xiyao Wang, Lonni Besancon, Michael J. McGuffin, and Tobias Isenberg. 2022. Collaborative Work in Augmented Reality: A Survey. IEEE Transactions on Visualization and Computer Graphics 28, 6 (2022), 2530–2549. https://doi.org/10.1109/TVCG.2020.3032761
[25]
Susan Leigh Star and James R. Griesemer. 1989. Institutional Ecology, ‘Translations’ and Boundary Objects: Amateurs and Professionals in Berkeley's Museum of Vertebrate Zoology, 1907-39. Social Studies of Science 19, 3 (1989), 387–420. https://doi.org/10.1177/030631289019003001
[26]
Maja Stark, Elisabeth Thielen, Christoph Holtmann, André Selmanagić, Michael Droste, and Leonid Barsht. 2022. XR Art and Culture: Successful Collaborations in Interdisciplinary Development Processes. i-com 21, 1 (2022), 123–138. https://doi.org/10.1515/icom-2022-0011 https://doi.org/10.1515/icom-2022-0011
[27]
Erik Stolterman, Jamie McAtee, David Royer, and Selvan Thandapani. 2008. Designerly Tools. In Undisciplined! Design Research Society Conference 2008. Sheffield Hallam University, Sheffield Hallam University, Sheffield, UK. https: //shura.shu.ac.uk/491/
[28]
Michael Tanaya, KouKeng Yang, Taran Christensen, Shen Li, Michael O'Keefe, James Fridley, and Kelvin Sung. 2017. A Framework for analyzing AR/VR Collaborations: An initial result. In 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA). IEEE, Annecy, France, 111–116. https://doi.org/10.1109/CIVEMSA.2017.79953112017.7995311
[29]
Unity Technologies. 24.07.23. Editor XR. https://unity.com/editorxr
[30]
Jinge Wang, Xiumin Fan, Yu Zhu, Xu Yang, and Xuyue Yin. 2022. Cross-platform AR annotation for assembly-design communication in pipe outfitting. The International Journal of Advanced Manufacturing Technology 121, 7-8 (2022), 4981–4998. https://doi.org/10.1007/s00170-022-09637-8
[31]
Yale University. 21.07.2022. User Interviews | Usability & Web Accessibility. https://usability.yale.edu/understanding-your-user/user-interviews
[32]
Cindy Ziker, Barbara Truman, and Heather Dodds. 2021. Cross Reality (XR): Challenges and Opportunities Across the Spectrum. In Innovative Learning Environments in STEM Higher Education, Jungwoo Ryoo and Kurt Winkelmann (Eds.). Springer International Publishing, Cham, 55–77. https://doi.org/10.1007/978-3-030-58948-6%7B_%7D4978-3-030-58948-6{_}4
Index Terms
- Extended Reality Authoring System for Creating Immersive Experiences: A Requirements Analysis
Recommendations
Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present a mobile system that enhances mixed reality experiences and games with force feedback by means of electrical muscle stimulation (EMS). The benefit of our approach is that it adds physical forces while keeping the users' hands free to interact ...
An Authoring Tool for XR Learning Environments
Extended RealityAbstractThe creation of extended reality applications, which combine elements of virtual reality, augmented reality and mixed reality, is complex and demanding, especially in education where its use has grown exponentially in recent years. This paper ...
A Recommender System of Extended Reality Experiences
ICIGP '20: Proceedings of the 2020 3rd International Conference on Image and Graphics ProcessingInterest in Extended Reality (XR) technologies - such as virtual, augmented, and mixed reality - has increased, due to the opportunities offered by such technologies to provide users with live immersive digital experiences. In particular, these ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2023
190 pages
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 December 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
KUI '23
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 76Total Downloads
- Downloads (Last 12 months)76
- Downloads (Last 6 weeks)11
Reflects downloads up to 14 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format