More Web Proxy on the site http://driver.im/

short-paper

Crossing Mixed Realities: A Review for Transitional Interfaces Design

Authors:

Elisabeth Mayer,

Francesco Chiossi,

Sven MayerAuthors Info & Claims

MuC '24: Proceedings of Mensch und Computer 2024

Pages 629 - 634

https://doi.org/10.1145/3670653.3677481

Published: 01 September 2024 Publication History

Abstract

Transitioning seamlessly from the real world into the digital world through the mixed reality continuum remains challenging. This paper investigates transitional design principles across the MR spectrum, anchored by a review of “The MagicBook”, a pioneering work that introduced the concept of transitional interfaces to the HCI community. Employing a forward-backward method, we reviewed 309 publications to understand the landscape of MR transitions. Our analysis outlines four distinct transition types within MR environments, offering a novel classification scheme. From this literature corpus, we identify four categories, setting a foundation for UX evaluation of transitional interfaces.

References

[1]

•Michael Aichem, Karsten Klein, Tobias Czauderna, Dimitar Garkov, Jinxin Zhao, Jian Li, and Falk Schreiber. 2022. Towards a hybrid user interface for the visual exploration of large biomolecular networks using virtual reality. Journal of integrative bioinformatics 19, 4 (2022), 20220034. https://doi.org/10.1515/jib-2022-0034

[2]

Christoph Anthes, Rubén Jesús García-Hernández, Markus Wiedemann, and Dieter Kranzlmüller. 2016. State of the Art of Virtual Reality Technology. In 2016 IEEE aerospace conference. IEEE, New York, NY, USA, 1–19. https://doi.org/10.1109/AERO.2016.7500674

[3]

Jonas Auda, Uwe Gruenefeld, Sarah Faltaous, Sven Mayer, and Stefan Schneegass. 2023. A Scoping Survey on Cross-reality Systems. ACM Comput. Surv. 56, 4, Article 83 (oct 2023), 38 pages. https://doi.org/10.1145/3616536

Digital Library

[4]

Jonas Auda, Uwe Gruenefeld, Sven Mayer, and Stefan Schneegass. 2023. The Actuality-Time Continuum: Visualizing Interactions and Transitions Taking Place in Cross-Reality Systems. In 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (2023-10-15) (ISMAR-Adjunct). IEEE, New York, NY, USA. https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00015

[5]

Ronald Azuma, Yohan Baillot, Reinhold Behringer, Steven Feiner, Simon Julier, and Blair MacIntyre. 2001. Recent Advances in Augmented Reality. IEEE computer graphics and applications 21, 6 (2001), 34–47. https://doi.org/10.1109/38.963459

Digital Library

[6]

•Charles B. Owen, Alison Dobbins, and Lisa Rebenitsch. 2014. Integrating the audience into a theatre performance using mobile devices. International Journal of Pervasive Computing and Communications 10, 1 (2014), 4–26. https://doi.org/10.1108/IJPCC-01-2014-0013

[7]

Nisa Bakkalbasi, Kathleen Bauer, Janis Glover, and Lei Wang. 2006. Three options for citation tracking: Google Scholar, Scopus and Web of Science. Biomedical digital libraries 3 (2006), 1–8. https://doi.org/10.1186/1742-5581-3-7

[8]

Mark Billinghurst, Hirokazu Kato, and Ivan Poupyrev. 2001. The magicbook-moving seamlessly between reality and virtuality. IEEE Computer Graphics and applications 21, 3 (2001), 6–8.

Digital Library

[9]

Doug A Bowman, Sabine Coquillart, Bernd Froehlich, Michitaka Hirose, Yoshifumi Kitamura, Kiyoshi Kiyokawa, and Wolfgang Stuerzlinger. 2008. 3d user interfaces: New directions and perspectives. IEEE computer graphics and applications 28, 6 (2008), 20–36. https://doi.org/10.1109/MCG.2008.109

Digital Library

[10]

Felipe G Carvalho, Daniela G Trevisan, and Alberto Raposo. 2012. Toward the design of transitional interfaces: an exploratory study on a semi-immersive hybrid user interface. Virtual Reality 16 (2012), 271–288. https://doi.org/10.1007/s10055-011-0205-y

Digital Library

[11]

•Adrian David Cheok, Xubo Yang, Zhou Zhi Ying, Mark Billinghurst, and Hirokazu Kato. 2002. Touch-space: Mixed reality game space based on ubiquitous, tangible, and social computing. Personal and ubiquitous computing 6 (2002), 430–442. https://doi.org/10.1007/s007790200047

Digital Library

[12]

Francesco Chiossi, Johannes Zagermann, Jakob Karolus, Nils Rodrigues, Priscilla Balestrucci, Daniel Weiskopf, Benedikt Ehinger, Tiare Feuchtner, Harald Reiterer, Lewis L Chuang, 2022. Adapting visualizations and interfaces to the user. it-Information Technology 64, 4-5 (2022), 133–143. https://doi.org/10.1515/itit-2022-0035

[13]

•Robbe Cools, Augusto Esteves, and Adalberto L Simeone. 2022. Blending spaces: Cross-reality interaction techniques for object transitions between distinct virtual and augmented realities. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, NY, USA, 528–537. https://doi.org/10.1109/ISMAR55827.2022.00069

[14]

•Larry Davis, Jannick Rolland, Felix Hamza-Lup, Yonggang Ha, Jack Norfleet, and C Imielinska. 2003. Enabling a continuum of virtual environment experiences. IEEE Computer Graphics and Applications 23, 2 (2003), 10–12. https://doi.org/10.1109/MCG.2003.1185574

Digital Library

[15]

•Felipe Gomes de Carvalho, Alberto Barbosa Raposo, and Marcelo Gattass. 2007. An Approach for Enabling the Use of Immersive Virtual Reality in Desktop Hybrid Interfaces. In Proceedings of the Second IASTED International Conference on Human Computer Interaction. ACTA Press, Calgary, AB, Canada, 68–73.

[16]

Barrett Ens, Benjamin Bach, Maxime Cordeil, Ulrich Engelke, Marcos Serrano, Wesley Willett, Arnaud Prouzeau, Christoph Anthes, Wolfgang Büschel, Cody Dunne, Tim Dwyer, Jens Grubert, Jason H. Haga, Nurit Kirshenbaum, Dylan Kobayashi, Tica Lin, Monsurat Olaosebikan, Fabian Pointecker, David Saffo, Nazmus Saquib, Dieter Schmalstieg, Danielle Albers Szafir, Matt Whitlock, and Yalong Yang. 2021. Grand Challenges in Immersive Analytics. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 459, 17 pages. https://doi.org/10.1145/3411764.3446866

Digital Library

[17]

Nico Feld, Pauline Bimberg, Benjamin Weyers, and Daniel Zielasko. 2023. Keep it simple? Evaluation of Transitions in Virtual Reality. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 196, 7 pages. https://doi.org/10.1145/3544549.3585811

Digital Library

[18]

Bernhard Fröhler, Christoph Anthes, Fabian Pointecker, Judith Friedl, Daniel Schwajda, Andreas Riegler, Shailesh Tripathi, Clemens Holzmann, Manuel Brunner, Herbert Jodlbauer, Hans-Christian Jetter, and Christoph Heinzl. 2022. A Survey on Cross-Virtuality Analytics. Computer Graphics Forum 41, 1 (2022), 465–494. https://doi.org/10.1111/cgf.14447

[19]

•Ava Fatah gen Schieck, Alan Penn, Chiron Mottram, Andreas Strothmann, Jan Ohlenburg, Wolfgang Broll, Francis Aish, and Simon Attfield. 2005. Interactive Space Generation through Play Exploring the Role of Simulation on the Design Table. International Journal of Architectural Computing 3, 1 (2005), 3–25. https://doi.org/10.1260/1478077053739612

[20]

•Raphael Grasset, Andreas Dunser, and Mark Billinghurst. 2008. The design of a mixed-reality book: Is it still a real book?. In 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, New York, NY, USA, 99–102. https://doi.org/10.1109/ISMAR.2008.4637333

Digital Library

[21]

•Raphaël Grasset, Philip Lamb, and Mark Billinghurst. 2005. Evaluation of mixed-space collaboration. In Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’05). IEEE, New York, NY, USA, 90–99. https://doi.org/10.1109/ISMAR.2005.30

Digital Library

[22]

•Raphael Grasset, Julian Looser, and Mark Billinghurst. 2006. Transitional interface: concept, issues and framework. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, New York, NY, USA, 231–232. https://doi.org/10.1109/ISMAR.2006.297819

Digital Library

[23]

•Sebastian Hubenschmid, Jonathan Wieland, Daniel Immanuel Fink, Andrea Batch, Johannes Zagermann, Niklas Elmqvist, and Harald Reiterer. 2022. ReLive: Bridging In-Situ and Ex-Situ Visual Analytics for Analyzing Mixed Reality User Studies. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 24, 20 pages. https://doi.org/10.1145/3491102.3517550

Digital Library

[24]

Malte Husung and Eike Langbehn. 2019. Of Portals and Orbs: An Evaluation of Scene Transition Techniques for Virtual Reality. In Proceedings of Mensch Und Computer 2019. Association for Computing Machinery, New York, NY, USA, 245–254. https://doi.org/10.1145/3340764.3340779

Digital Library

[25]

•Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis, and Tiare Feuchtner. 2021. Transitional Interfaces in Mixed and Cross-Reality: A new frontier?. In Companion Proceedings of the 2021 Conference on Interactive Surfaces and Spaces (Lodz, Poland) (ISS ’21). Association for Computing Machinery, New York, NY, USA, 46–49. https://doi.org/10.1145/3447932.3487940

Digital Library

[26]

Alexandra Kitson, Elizabeth Buie, Ekaterina R. Stepanova, Alice Chirico, Bernhard E. Riecke, and Andrea Gaggioli. 2019. Transformative Experience Design: Designing with Interactive Technologies to Support Transformative Experiences. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3290607.3311762

Digital Library

[27]

Kiyoshi Kiyokawa, Hidehiko Iwasa, Haruo Takemura, and Naokazu Yokoya. 1998. Collaborative immersive workspace through a shared augmented environment. In Intelligent Systems in Design and Manufacturing, Vol. 3517. SPIE, Bellingham, WA, USA, 2–13. https://doi.org/10.1117/12.326923

[28]

Florida Atlantic University Libraries. 2024. Literature Reviews & Systematic Reviews. https://libguides.fau.edu/c.php?g=966176&p=7013756 [Online; accessed 06-06-2024].

[29]

Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2143–2152. https://doi.org/10.1145/2702123.2702382

Digital Library

[30]

Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12 (1994), 1321–1329.

[31]

•Rasimah Che Mohd. Yusoff and Halimah Badioze Zaman. 2009. Mixed Reality Book: A Visualization Tool. In Visual Informatics: Bridging Research and Practice: First International Visual Informatics Conference. Springer, Cham, Switzerland, 326–336. https://doi.org/10.1007/978-3-642-05036-7_31

Digital Library

[32]

Joseph O’Hagan, Julie R. Williamson, Florian Mathis, Mohamed Khamis, and Mark McGill. 2023. Re-Evaluating VR User Awareness Needs During Bystander Interactions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 876, 17 pages. https://doi.org/10.1145/3544548.3581018

Digital Library

[33]

•Thammathip Piumsomboon, Gavin Ong, Cameron Urban, Barrett Ens, Jack Topliss, Xiaoliang Bai, and Simon Hoermann. 2022. Ex-Cit XR: Expert-elicitation and validation of Extended Reality visualisation and interaction techniques for disengaging and transitioning users from immersive virtual environments. Frontiers in Virtual Reality 3 (2022), 943696. https://doi.org/10.3389/frvir.2022.943696

[34]

Fabian Pointecker, Judith Friedl, Daniel Schwajda, Hans-Christian Jetter, and Christoph Anthes. 2022. Bridging the Gap Across Realities: Visual Transitions Between Virtual and Augmented Reality. In 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, New York, NY, USA, 827–836. https://doi.org/10.1109/ISMAR55827.2022.00101

[35]

Fabian Pointecker, Hans-Christian Jetter, and Christoph Anthes. 2020. Exploration of visual transitions between virtual and augmented reality. In Workshop on Immersive Analytics: Envisioning Future Productivity for Immersive Analytics @ CHI.

[36]

JP Rolland, K Stanney, B Goldiez, J Daly, G Martin, M Moshell, and D Washburn. 2004. Overview of research in augmented and virtual environments: RAVES. In Proceedings of the International Conference on Cybernetics and Information Technologies, Systems and Applications (CITSA’04), Vol. 4. 19–24.

[37]

•Jannick P Rolland, Frank Biocca, Felix Hamza-Lup, Yanggang Ha, and Ricardo Martins. 2005. Development of head-mounted projection displays for distributed, collaborative, augmented reality applications. Presence: Teleoperators & Virtual Environments 14, 5 (2005), 528–549. https://doi.org/10.1162/105474605774918741

Digital Library

[38]

Joan Sol Roo and Martin Hachet. 2017. One Reality: Augmenting How the Physical World is Experienced by combining Multiple Mixed Reality Modalities. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 787–795. https://doi.org/10.1145/3126594.3126638

Digital Library

[39]

Kieron Sheehy. 2010. Inclusive education and virtual worlds: the Teacher Embodiment And LEarning Affordance Framework (TEALEAF). Virtual Worlds: Controversies at the Frontier of Education (2010), 159.

[40]

Adalberto L. Simeone, Mohamed Khamis, Augusto Esteves, Florian Daiber, Matjaž Kljun, Klen Čopič Pucihar, Poika Isokoski, and Jan Gugenheimer. 2020. International Workshop on Cross-Reality (XR) Interaction. In Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces (Virtual Event, Portugal) (ISS ’20). Association for Computing Machinery, New York, NY, USA, 111–114. https://doi.org/10.1145/3380867.3424551

Digital Library

[41]

Mel Slater and Martin Usoh. 1993. Presence in immersive virtual environments. In Proceedings of IEEE virtual reality annual international symposium. IEEE, New York, NY, USA, 90–96. https://doi.org/10.1109/VRAIS.1993.380793

Digital Library

[42]

Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is Mixed Reality?. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300767

Digital Library

[43]

Nanjia Wang and Frank Maurer. 2022. A Design Space for Single-User Cross-Reality Applications. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (Frascati, Rome, Italy) (AVI 2022). Association for Computing Machinery, New York, NY, USA, Article 31, 5 pages. https://doi.org/10.1145/3531073.3531116

Digital Library

[44]

•Carolin Wienrich, Philipp Komma, Stephanie Vogt, and Marc E Latoschik. 2021. Spatial presence in mixed realities–Considerations about the concept, measures, design, and experiments. Frontiers in Virtual Reality 2 (2021), 694315. https://doi.org/10.3389/frvir.2021.694315

Cited By

Chiossi FEl Khaoudi YOu CSidenmark LZaky AFeuchtner TMayer S(2024)Evaluating Typing Performance in Different Mixed Reality Manifestations using Physiological FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36981428:ISS(377-406)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698142

Index Terms

Crossing Mixed Realities: A Review for Transitional Interfaces Design
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Index terms have been assigned to the content through auto-classification.

Recommendations

A Scoping Survey on Cross-reality Systems
Immersive technologies such as Virtual Reality (VR) and Augmented Reality (AR) empower users to experience digital realities. Known as distinct technology classes, the lines between them are becoming increasingly blurry with recent technological ...
Mixed reality in virtual world teleconferencing
VR '10: Proceedings of the 2010 IEEE Virtual Reality Conference

In this paper we present a Mixed Reality (MR) teleconferencing application based on Second Life (SL) and the OpenSim virtual world. Augmented Reality (AR) techniques are used for displaying virtual avatars of remote meeting participants in real physical ...
Investigating the balance between virtuality and reality in mobile mixed reality UI design: user perception of an augmented city
NordiCHI '14: Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational

Examples of mixed reality mobile applications and research combining virtual and real world data in the same view have emerged during recent years. However, currently there is little knowledge of users' perceptions comparing the role of virtual and real ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '24: Proceedings of Mensch und Computer 2024

September 2024

719 pages

ISBN:9798400709982

DOI:10.1145/3670653

Editors:
Alexander Maedche
Karlsruhe Institute of Technology, Germany
,
Michael Beigl
Karlsruhe Institute of Technology, Germany
,
Kathrin Gerling
Karlsruhe Institute of Technology, Germany
,
Sven Mayer
LMU Munich, Germany

Copyright © 2024 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

MuC '24

MuC '24: Mensch und Computer 2024

September 1 - 4, 2024

Karlsruhe, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
100
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)63

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chiossi FEl Khaoudi YOu CSidenmark LZaky AFeuchtner TMayer S(2024)Evaluating Typing Performance in Different Mixed Reality Manifestations using Physiological FeaturesProceedings of the ACM on Human-Computer Interaction10.1145/36981428:ISS(377-406)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698142

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents