Remote Expert Assistance System for Mixed-HMD Clients over 5G Infrastructure
Authors: 
Frank ter Haar, Sylvie Dijkstra-Soudarissanane, Piotr Zuraniewski, Rick Hindriks, Karim El Assal, Simon Gunkel, Galit Rahim, Omar NiamutAuthors Info & Claims
Pages 318 - 322
Abstract
When operating under adverse conditions or at distant locations, it is not always feasible to obtain the assistance of an expert on site. In such cases, remote expert assistance may provide a solution. Current remote assistance systems employ immersive data visualization or video-based communication. By introducing XR-based multi-user communication system to remote expert assistance solutions, we expect to improve the effectiveness of both the operator and the supporting experts. Our multi-user XR collaboration demo integrates XR and cloud/network technologies. It enables three users to collaborate in a way that makes them feel that they are solving a challenging task together.
References
[1]
Michael Abramovici, Mario Wolf, Stefan Adwernat, and Matthias Neges. 2017. Context-aware maintenance support for augmented reality assistance and synchronous multi-user collaboration. Procedia CIRP 59 (2017), 18--22. Proceedings of the 5th International Conference in Through-life Engineering Services Cranfield University, 1st and 2nd November 2016.
[2]
Tomáš Boros, Piotr Zuraniewski, Rick Hindriks, Niels van Adrichem, Emmanuel Thomas, and Lucia D'Acunto. 2019. Enabling superior and controllable video streaming QoE with 5G network orchestration. In 2019 22nd Conference on Innovation in Clouds, Internet and Networks and Workshops (ICIN). 124--129.
[3]
Ana Cachada, David Costa, Hasmik Badikyan, José Barbosa, Paulo Leitão, Osmano Morais, Carlos Teixeira, João Azevedo, Pedro Miguel Moreira, and Luís Romero. 2019. Using AR interfaces to support industrial maintenance procedures. In IECON 2019 - 45th Annual Conference of the IEEE Industrial Electronics Society, Vol. 1. 3795--3800.
[4]
Sylvie Dijkstra-Soudarissanane, Karim El Assal, Simon Gunkel, Frank ter Haar, Rick Hindriks, Jan Willem Kleinrouweler, and Omar Niamut. 2019. Multi-sensor capture and network processing for virtual reality conferencing. In Proceedings of the 10th ACM Multimedia Systems Conference. 316--319.
[5]
Ali El Essaili, Sara Thorson, Alvin Jude, Jörg Christian Ewert, Natalya Tyudina, Héctor Caltenco, Lukasz Litwic, and Bo Burman. 2022. Holographic communication in 5G networks. Ericsson Technology Review 2022, 5 (2022), 2--11.
[6]
F E Fadzli, M S Kamson, A W Ismail, and M Y F Aladin. 2020. 3d telepresence for remote collaboration in extended reality (xR) application. IOP Conference Series: Materials Science and Engineering 979, 1 (nov 2020), 012005.
[7]
Jerônimo Gustavo Grandi, Henrique Galvan Debarba, and Anderson Maciel. 2019. Characterizing asymmetric collaborative interactions in virtual and augmented realities. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 127--135.
[8]
Simon NB Gunkel, Hans M Stokking, Martin J Prins, Nanda van der Stap, Frank B ter Haar, and Omar A Niamut. 2018. Virtual reality conferencing: multi-user immersive VR experiences on the web. In Proceedings of the 9th ACM Multimedia Systems Conference. 498--501.
[9]
Yongjae Lee and Byounghyun Yoo. 2021. XR collaboration beyond virtual reality: work in the real world. Journal of Computational Design and Engineering 8, 2 (03 2021), 756--772. arXiv:https://academic.oup.com/jcde/article-pdf/8/2/756/37562008/qwab012.pdf
[10]
Stephan Lukosch, Mark Billinghurst, Leila Alem, and Kiyoshi Kiyokawa. 2015. Collaboration in augmented reality. Computer Supported Cooperative Work (CSCW) 24 (12 2015).
[11]
Nels Numan and Anthony Steed. 2022. Exploring user behaviour in asymmetric collaborative mixed reality. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (Tsukuba, Japan) (VRST '22). Association for Computing Machinery, New York, NY, USA, Article 6, 11 pages.
[12]
Sergio Orts, Christoph Rhemann, Sean Fanello, David Kim, Adarsh Kowdle, Wayne Chang, Yury Degtyarev, Philip Davidson, Sameh Khamis, Minsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip Chou, Sarah Mennicken, Julien Valentin, Pushmeet Kohli, Vivek Pradeep, Shenlong Wang, and Shahram Izadi. 2016. Holoportation: virtual 3d teleportation in real-time.
[13]
Hasan Sumdani, Pedro Aguilar-Salinas, Mauricio J. Avila, Samuel R. Barber, and Travis Dumont. 2022. Utility of augmented reality and virtual reality in spine surgery: a systematic review of the literature. World Neurosurgery 161 (2022), e8--e17.
[14]
K. S. Tang, D. L. Cheng, E. Mi, and P. B. Greenberg. 2020. Augmented reality in medical education: a systematic review. Canadian medical education journal 11 (2020), e81--e96. Issue 1. accepted 18 April 2023
Index Terms
- Remote Expert Assistance System for Mixed-HMD Clients over 5G Infrastructure
Index terms have been assigned to the content through auto-classification.
Recommendations
UnMapped: Leveraging Experts’ Situated Experiences to Ease Remote Guidance in Collaborative Mixed Reality
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsCollaborative Mixed Reality (MR) systems that help extend expertise for physical tasks to remote environments often situate experts in an immersive view of the task environment to bring the collaboration closer to collocated settings. In this paper, we ...
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyA common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2023
495 pages
ISBN:9798400701481
DOI:10.1145/3587819
- Co-chairs:
- Shervin Shirmohammadi,
- Mohamed Hefeeda,
- Program Co-chairs:
- Roger Zimmermann,
- Carsten Griwodz,
- Mea Wang
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 June 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MMSys '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 176 of 530 submissions, 33%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 127Total Downloads
- Downloads (Last 12 months)43
- Downloads (Last 6 weeks)1
Reflects downloads up to 02 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in