Are We There Yet? Unravelling Usability Challenges and Opportunities in Collaborative Immersive Analytics for Domain Experts
Pages 159 - 181
Abstract
In the ever-evolving discipline of high-dimensional scientific data, collaborative immersive analytics (CIA) offers a promising frontier for domain experts in complex data visualization and interpretation. This research presents a comprehensive framework for conducting usability studies on the extended reality (XR) interface of ParaView, an open-source CIA system. By employing established human-computer interaction (HCI) principles, including Jakob Nielsen’s Usability Heuristics, Cognitive Load Theory, NASA Task Load Index, System Usability Scale, Affordance Theory, and Gulf of Execution and Evaluation, this study aims to identify underlying usability issues and provide guidelines for enhancing user experience in scientific domains. Our findings reveal significant usability challenges in the ParaView XR interface that impede effective teamwork and collaboration. For instance, the lack of synchronous collaboration, limited communication methods, and the absence of role-based data access are critical areas that need attention. Additionally, inadequate error handling, insufficient feedback mechanisms, and limited support resources during application use require extensive improvement to fully utilize the system’s potential. Our study suggests potential improvements to overcome the existing usability barriers of the collaborative immersive system.
References
[1]
Business Intelligence and Analytics Software | Tableau. https://www.tableau.com/. Accessed 24 May 2024
[2]
MATLAB. https://www.mathworks.com/products/matlab.html. Accessed 24 May 2024
[3]
Matplotlib - Visualization with Python. https://matplotlib.org/. Accessed 24 May 2024
[4]
R: The R Project for Statistical Computing. https://www.r-project.org/. Accessed 24 May 2024
[5]
Seaborn: Statistical Data Visualization. https://seaborn.pydata.org/. Accessed 24 May 2024
[6]
Afshar, M., Samet, S., Usefi, H.: Incorporating behavior in attribute based access control model using machine learning. In: Proceedings of IEEE International Systems Conference (SysCon). pp. 1–8 (2021).
[7]
Ahrens, J., Geveci, B., Law, C., Hansen, C., Johnson, C.: 36-paraview: an end-user tool for large-data visualization. Visualizat. Handbook 717, 50038-1 (2005).
[8]
Alam MS, Mohamed FB, Selamat A, and Hossain AB A review of recurrent neural network based camera localization for indoor environments IEEE Access 2023 11 43985-44009
[9]
Alzubaidi L et al. Novel transfer learning approach for medical imaging with limited labeled data Cancers 2021 13 7 1590
[10]
Angryk RA et al. Multivariate time series dataset for space weather data analytics Sci. Data 2020 7 1 227
[11]
Ayachit, U.: The ParaView Guide: A Parallel Visualization Application. Kitware, Inc., Clifton Park (2015). https://dl.acm.org/doi/book/10.5555/2789330
[12]
Azuma, R.T.: A survey of augmented reality. Pres. Teleoper. Virtual Environ. 6(4), 355–385 (1997)
[13]
Azzam R, Alkendi Y, Taha T, Huang S, and Zweiri Y A stacked LSTM-based approach for reducing semantic pose estimation error IEEE Trans. Inst. Meas. 2021 70 1-14
[14]
Bach, B., Dachselt, R., Carpendale, S., Dwyer, T., Collins, C., Lee, B.: Immersive analytics: exploring future interaction and visualization technologies for data analytics. In: Proceedings of ACM International Conference on Interactive Surfaces and Spaces (2016).
[15]
Bangor A, Kortum PT, and Miller JT An empirical evaluation of the system usability scale Int. J. Hum.-Comput. Interact. 2008 24 6 574-594
[16]
Billinghurst, M., Cordeil, M., Bezerianos, A., Margolis, T.: Collaborative immersive analytics. In: Immersive Analytics, pp. 221–257 (2018).
[17]
Burdea GC and Coiffet P Virtual Reality Technology 2003 Hoboken John Wiley & Sons
[18]
Butcher PWS, John NW, and Ritsos PD VRIA: a web-based framework for creating immersive analytics experiences IEEE Trans. Visual Comput. Graph. 2021 27 7 3213-3225
[19]
Chen L, Liang HN, Lu F, Wang J, Chen W, and Yue Y Effect of collaboration mode and position arrangement on immersive analytics tasks in virtual reality: a pilot study Appl. Sci. 2021 11 21 10473
[20]
Cordeil, M., et al.: IATK: an immersive analytics toolkit. In: Proceedings of IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 200–209 (2019).
[21]
Covolan, J.P.M., Sementille, A.C., Sanches, S.R.R.: A mapping of visual SLAM algorithms and their applications in augmented reality. In: Proceedings of Symposium on Virtual and Augmented Reality (SVR), pp. 20–29 (2020).
[22]
Dasgupta, A., Manuel, M., Mansur, R.S., Nowak, N., Gračanin, D.: Towards real time object recognition for context awareness in mixed reality: a machine learning approach. In: Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), pp. 262–268 (2020).
[23]
DeYoung, J., Berry, J., Riggs, S., Wesson, J., Wertz, L.C.: Evaluating embodied navigation in virtual reality environments. In: Proceedings of IEEE Games, Entertainment, Media Conference (GEM), pp. 1–9 (2018).
[24]
Du J, Zou Z, Shi Y, and Zhao D Zero latency: real-time synchronization of BIM data in virtual reality for collaborative decision-making Autom. Constr. 2018 85 51-64
[25]
Durrant-Whyte H and Bailey T Simultaneous localization and mapping: part I IEEE Rob. Autom. Maga. 2006 13 2 99-110
[26]
Ens, B., et al.: Grand challenges in immersive analytics. In: Proceedings of CHI Conference on Human Factors in Computing Systems, pp. 1–17 (2021).
[27]
Feick, M., Kleer, N., Tang, A., Krüger, A.: The virtual reality questionnaire toolkit. In: Adjunct Proceedings of Annual ACM Symposium on User Interface Software and Technology, p. 68–69 (2020).
[28]
Ferraiolo DF, Sandhu R, Gavrila S, Kuhn DR, and Chandramouli R Proposed NIST standard for role-based access control ACM Trans. Inf. Syst. Secur. (TISSEC) 2001 4 3 224-274
[29]
Fonnet A and Prié Y Survey of immersive analytics IEEE Trans. Visual Comput. Graph. 2021 27 3 2101-2122
[30]
Fraser, M., et al.: Revealing the realities of collaborative virtual reality. In: Proceedings of International Conference on Collaborative Virtual Environments (2000).
[31]
Fraser, N.: Differential synchronization. In: Proceedings of ACM Symposium on Document Engineering, pp. 13–20 (2009).
[32]
Gibson, J.J.: The Theory of Affordances. Hilldale, USA 1(2), 67–82 (1977). https://hal.science/hal-00692033
[33]
Ginosar, R., Kol, R.: Adaptive synchronization. In: Proceedings International Conference on Computer Design. VLSI in Computers and Processors (Cat. No. 98CB36273), pp. 188–189 (1998).
[34]
Hart, S.G.: NASA-task Load Index (NASA-TLX); 20 years later. In: Proceedings of Human Factors and Ergonomics Society Annual Meeting, pp. 904–908 (2006).
[35]
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Advances in Psychology, vol. 52, pp. 139–183. Elsevier, North-Holland (1988).
[36]
Haryana MRA, Warsono S, Achjari D, and Nahartyo E Virtual reality learning media with innovative learning materials to enhance individual learning outcomes based on cognitive load theory Int. J. Manag. Educ. 2022 20 3 100657
[37]
Holmberg, C., Hakansson, S., Eriksson, G.: Web Real-Time Communication Use Cases and Requirements. RFC 7478 (2015). https://rfc-editor.org/rfc/rfc7478.txt
[38]
Hoppenstedt B et al. Applicability of immersive analytics in mixed reality: usability study IEEE Access 2019 7 71921-71932
[39]
Hu VC, Kuhn DR, Ferraiolo DF, and Voas J Attribute-based access control Computer 2015 48 2 85-88
[40]
Isaacs, K.E., et al.: State of the art of performance visualization. EuroVis (STARs) 3, 6 (2014).
[41]
Isenberg P, Elmqvist N, Scholtz J, Cernea D, Ma KL, and Hagen H Collaborative visualization: definition, challenges, and research agenda Inf. Vis. 2011 10 4 310-326
[42]
Kerren, A., Schreiber, F.: Toward the role of interaction in visual analytics. In: Proceedings of Winter Simulation Conference (WSC), pp. 1–13 (2012).
[43]
Kraus, M., et al.: Immersive analytics with abstract 3D visualizations: a survey. In: Proceedings of Computer Graphics Forum, vol. 41, pp. 201–229 (2022).
[44]
Kraus M, Klein K, Fuchs J, Keim DA, Schreiber F, and Sedlmair M The value of immersive visualization IEEE Comput. Graph. Appl. 2021 41 4 125-132
[45]
Lee B, Hu X, Cordeil M, Prouzeau A, Jenny B, and Dwyer T Shared surfaces and spaces: collaborative data visualisation in a co-located immersive environment IEEE Trans. Visual Comput. Graph. 2021 27 2 1171-1181
[46]
Marriott, K., et al.: Immersive Analytics, vol. 11190. Springer, Heidelberg (2018)
[47]
Meta: Quest 2. https://www.meta.com/quest/products/quest-2/. Accessed 24 May 2024
[48]
Nakazato J, Nakagawa K, Itoh K, Fontugne R, Tsukada M, and Esaki H WebRTC over 5 G: a study of remote collaboration QoS in mobile environment J. Netw. Syst. Manage. 2024 32 1 1
[49]
Nguyen, C., DiVerdi, S., Hertzmann, A., Liu, F.: Vremiere: in-headset virtual reality video editing. In: Proceedings of CHI Conference on Human Factors in Computing Systems, pp. 5428–5438 (2017).
[50]
Nguyen, H., Marendy, P., Engelke, U.: Collaborative framework design for immersive analytics. In: Proceedings of Big Data Visual Analytics (BDVA), pp. 1–8 (2016).
[51]
Nielsen, J.: Usability inspection methods. In: Proceedings of Conference Companion on Human Factors in Computing Systems, pp. 413–414 (1994). https://dl.acm.org/doi/pdf/10.1145/259963.260531
[52]
Norman DA Cognitive engineering User Cent. Syst. Des. 1986 31 61 2
[53]
Park JS, Sandhu R, and Ahn GJ Role-based access control on the web ACM Trans. Inf. Syst. Secur. 2001 4 1 37-71
[54]
Petrangeli, S., Pauwels, D., van der Hooft, J., Wauters, T., De Turck, F., Slowack, J.: Improving quality and scalability of WebRTC video collaboration applications. In: Proceedings of ACM Multimedia Systems Conference, pp. 533–536 (2018).
[55]
Plass JL, Moreno R, and Brünken R Cognitive Load Theory 2010 Cambridge Cambridge University Press
[56]
Radu, I., Joy, T., Bowman, Y., Bott, I., Schneider, B.: A survey of needs and features for augmented reality collaborations in collocated spaces. In: Proceedings of the ACM on Human-Computer Interaction, vol. 5, no. (CSCW1) (2021).
[57]
Ramaseri Chandra, A.N., El Jamiy, F., Reza, H.: A review on usability and performance evaluation in virtual reality systems. In: Proceedings of International Conference on Computational Science and Computational Intelligence (CSCI), pp. 1107–1114 (2019).
[58]
Reski N, Alissandrakis A, and Kerren A An empirical evaluation of asymmetric synchronous collaboration combining immersive and non-immersive interfaces within the context of immersive analytics Front. Virtual Real. 2022 2 743445
[59]
del Rosario, E., et al.: Gauge: an interactive data-driven visualization tool for HPC application I/O performance analysis. In: Proceedings of IEEE/ACM Fifth International Parallel Data Systems Workshop (PDSW), pp. 15–21 (2020).
[60]
Saffo D et al. Unraveling the design space of immersive analytics: a systematic review IEEE Trans. Visual Comput. Graph. 2024 30 1 495-506
[61]
Sandhu, R.S.: Role-based access control. In: Advances in Computers, vol. 46, pp. 237–286. Elsevier (1998).
[62]
Seraji, M.R., Stuerzlinger, W.: XVCollab: an immersive analytics tool for asymmetric collaboration across the virtuality spectrum. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 146–154 (2022).
[63]
Servos D and Osborn SL Current research and open problems in attribute-based access control ACM Comput. Surv. 2017 49 4 1-45
[64]
Shamshad F et al. Transformers in medical imaging: a survey Med. Image Anal. 2023 88 102802
[65]
Souchet AD, Philippe S, Lourdeaux D, and Leroy L Measuring visual fatigue and cognitive load via eye tracking while learning with virtual reality head-mounted displays: a review Int. J. Hum.-Comput. Interact. 2022 38 9 801-824
[66]
Su P, Luo S, and Huang X Real-time dynamic SLAM algorithm based on deep learning IEEE Access 2022 10 87754-87766
[67]
Su, S., Lopez-Coto, I., Sherman, W.R., Sayrafian, K., Terrill, J.: Immersive ParaView: an immersive scientific workflow for the advancement of measurement science. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 139–145 (2022).
[68]
Sweller J, Van Merrienboer JJ, and Paas FG Cognitive architecture and instructional design Educ. Psychol. Rev. 1998 10 251-296
[69]
Szafir, D.: Mediating human-robot interactions with virtual, augmented, and mixed reality. In: Proceedings of the Virtual, Augmented and Mixed Reality, pp. 124–149 (2019).
[70]
Tan, H., Zhang, Z., Zou, X., Liao, Q., Xia, W.: Exploring the potential of fast delta encoding: marching to a higher compression ratio. In: Proceedings of IEEE International Conference on Cluster Computing (CLUSTER), pp. 198–208 (2020).
[71]
Tateno, K., Tombari, F., Laina, I., Navab, N.: CNN-SLAM: real-time dense monocular SLAM with learned depth prediction. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6243–6252 (2017).
[72]
Wagner, J., Stuerzlinger, W., Nedel, L.: The effect of exploration mode and frame of reference in immersive analytics. IEEE Trans. Visualizat. Comput. Graph. 28(9) (2022).
[73]
Wang, W., Cheng, J., Guo, J.L.: Usability of virtual reality application through the lens of the user community: a case study. In: Proceedings of Extended Abstracts of CHI Conference on Human Factors in Computing Systems, pp. 1–6 (2019).
[74]
Whitlock, M., Smart, S., Szafir, D.A.: Graphical perception for immersive analytics. In: Proceedings of IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 616–625 (2020).
[75]
Wijaya, A.C., Munandar, M.W.A., Utaminingrum, F.: Usability testing of augmented reality for food advertisement based on mobile phone using system usability scale. In: Proceedings of International Conference on Sustainable Information Engineering and Technology (SIET), pp. 266–269 (2019).
[76]
Zagermann, J., Hubenschmid, S., Fink, D.I., Wieland, J., Reiterer, H., Feuchtner, T.: Challenges and opportunities for collaborative immersive analytics with hybrid user interfaces. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 191–195 (2023).
[77]
Zhang, J., et al.: Earth-affecting solar transients: a review of progresses in solar cycle 24. Prog. Earth Planet. Sci. 8(1), 56:1–56:102 (2021).
[78]
Zhang L, Wei L, Shen P, Wei W, Zhu G, and Song J Semantic SLAM based on object detection and improved octomap IEEE Access 2018 6 75545-75559
[79]
Zhang W, Han B, and Hui P SEAR: scaling experiences in multi-user augmented reality IEEE Trans. Visual Comput. Graph. 2022 28 5 1982-1992
[80]
Zheng B, Jiang X, Tien G, Meneghetti A, Panton ONM, and Atkins MS Workload assessment of surgeons: correlation between NASA TLX and blinks Surg. Endosc. 2012 26 2746-2750
Index Terms
- Are We There Yet? Unravelling Usability Challenges and Opportunities in Collaborative Immersive Analytics for Domain Experts
Index terms have been assigned to the content through auto-classification.
Recommendations
FIESTA: A Free Roaming Collaborative Immersive Analytics System
ISS '19: Proceedings of the 2019 ACM International Conference on Interactive Surfaces and SpacesWe present FIESTA, a prototype system for collaborative immersive analytics (CIA). In contrast to many existing CIA prototypes, FIESTA allows users to collaboratively work together wherever and however they wish---untethered from mandatory physical ...
Building a Prototype for Easy to Use Collaborative Immersive Analytics
Computational Science – ICCS 2021AbstractThe increase in the size and complexity of today’s datasets creates a need to develop and experiment with novel data visualization methods. One of these innovations is immersive analytics, in which extended reality technologies such as virtual ...
Usability evaluation of an accessible collaborative writing prototype for blind users
Collaborative writing technology is utilized in the workplace to co-author documents. Unfortunately, this technology is not accessible or usable for persons who are blind. As a result, persons who are blind cannot participate in collaborative writing ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Jun 2024
463 pages
ISBN:978-3-031-76811-8
DOI:10.1007/978-3-031-76812-5
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 15 December 2024
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Mar 2025