Abstract
In this paper, we discuss work-in-progress research on tangible interfaces for interactive cutaway visualizations in Mixed Reality (MR). We present an approach that allows users to flexibly and intuitively define virtual cutaway geometry by directly interacting with real-world objects. Using hand movements the user physically traces the shape of the cutaway on an object, without the need for specialized input devices. Tangible interaction allows more accurate interaction and makes it easier for users to plan the placement and shape of required cutaways that fit the object. We developed a prototype demonstrator on the Microsoft HoloLens 2 and present the design and implementation details for such a system and discuss insights, gained from preliminary testing, that motivate compelling directions for future work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Arora, J., Saini, A., Mehra, N., Jain, V., Shrey, S., Parnami, A.: VirtualBricks: exploring a scalable, modular toolkit for enabling physical manipulation in VR. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI 2019, pp. 1–12. ACM, New York (2019). https://doi.org/10.1145/3290605.3300286
Besançon, L., Issartel, P., Ammi, M., Isenberg, T.: Mouse, tactile, and tangible input for 3D manipulation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI 2017, pp. 4727–4740. ACM, New York (2017). https://doi.org/10.1145/3025453.3025863
Brooke, J.: SUS: a quick and dirty usability scale. In: Jordan, P., Thomas, B., Weerdmeester, B., McClelland, I. (eds.) Usability Evaluation in Industry, pp. 189–194. CRC Press (1996)
Burns, M., Finkelstein, A.: Adaptive cutaways for comprehensible rendering of polygonal scenes. ACM Trans. Graphics 27(5), 154:1–154:7 (2008). https://doi.org/10.1145/1409060.1409107
Coffin, C., Hollerer, T.: Interactive perspective cut-away views for general 3D scenes. In: 3D User Interfaces (3DUI 2006), pp. 25–28 (2006). https://doi.org/10.1109/VR.2006.88
Diepstraten, J., Weiskopf, D., Ertl, T.: Interactive cutaway illustrations. Comput. Graph. Forum 22(3), 523–532 (2003). https://doi.org/10.1111/1467-8659.t01-3-00700
Feiner, S.K., Seligmann, D.D.: Cutaways and ghosting: satisfying visibility constraints in dynamic 3D illustrations. Vis. Comput. 8(5), 292–302 (1992). https://doi.org/10.1007/BF01897116
He, F., Hu, X., Shi, J., Qian, X., Wang, T., Ramani, K.: UBI edge: authoring edge-based opportunistic tangible user interfaces in augmented reality. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, pp. 1–14. ACM, New York (2023). https://doi.org/10.1145/3544548.3580704
Hettiarachchi, A., Wigdor, D.: Annexing reality: enabling opportunistic use of everyday objects as tangible proxies in augmented reality. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI 2016, pp. 1957–1967. ACM, New York (2016). https://doi.org/10.1145/2858036.2858134
Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008). https://doi.org/10.1145/1349026.1349034
Lee, G.A., Kim, G.J., Billinghurst, M.: Immersive authoring: what you experience is what you get (WYXIWYG). Commun. ACM 48(7), 76–81 (2005). https://doi.org/10.1145/1070838.1070840
Li, W., Ritter, L., Agrawala, M., Curless, B., Salesin, D.: Interactive cutaway illustrations of complex 3D models. ACM Trans. Graph. 26(3), 31–es (2007). https://doi.org/10.1145/1276377.1276416
Liang, R., Clapworthy, G., Krokos, M., Mayoral, R.: Real-time predefined shape cutaway with parametric boundaries. In: International Conference on Computer Graphics, Imaging and Visualization (CGIV 2005), pp. 227–231 (2005). https://doi.org/10.1109/CGIV.2005.64
Lidal, E.M., Hauser, H., Viola, I.: Design principles for cutaway visualization of geological models. In: Proceedings of the 28th Spring Conference on Computer Graphics, SCCG 2012, pp. 47–54. ACM, New York (2012). https://doi.org/10.1145/2448531.2448537
Looser, J., Billinghurst, M., Cockburn, A.: Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces. In: Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, GRAPHITE 2004, pp. 204–211. ACM, New York (2004). https://doi.org/10.1145/988834.988870
Matviienko, A., Langer, M., Müller, F., Schmitz, M., Mühlhäuser, M.: VRtangibles: assisting children in creating virtual scenes using tangible objects and touch input. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA 2021, pp. 1–7. ACM, New York (2021). https://doi.org/10.1145/3411763.3451671
Monteiro, K., Vatsal, R., Chulpongsatorn, N., Parnami, A., Suzuki, R.: Teachable reality: prototyping tangible augmented reality with everyday objects by leveraging interactive machine teaching. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, pp. 1–15. ACM, New York (2023). https://doi.org/10.1145/3544548.3581449
Netto, L.F., Celes, W.: A new focus+context visualization technique for inspecting black oil reservoir models. In: 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 25–32 (2021). https://doi.org/10.1109/SIBGRAPI54419.2021.00013. ISSN 2377-5416
Shaer, O., Hornecker, E.: Tangible user interfaces: past, present, and future directions. Found. Trends Hum.-Comput. Interact. 3(1–2), 4–137 (2010). https://doi.org/10.1561/1100000026
Sigg, S., Fuchs, R., Carnecky, R., Peikert, R.: Intelligent cutaway illustrations. In: 2012 IEEE Pacific Visualization Symposium, pp. 185–192 (2012). https://doi.org/10.1109/PacificVis.2012.6183590. ISSN 2165-8773
Sin, A.K., Badioze Zaman, H.: Tangible interaction in learning astronomy through augmented reality book-based educational tool. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 302–313. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-05036-7_29
Wang, Q., Li, C., Huang, X., Tang, M.: Tangible interface: integration of the real and virtual. In: The 7th International Conference on Computer Supported Cooperative Work in Design, pp. 408–412. IEEE, Rio de Janeiro, Brazil (2002). https://doi.org/10.1109/CSCWD.2002.1047723
Acknowledgments
This work is supported by the Science Foundation Ireland Centres for Research Training in Digitally-Enhanced Reality and Artificial Intelligence under Grant Nos. 18/CRT/6224 and 18/CRT/6223; a Trinity College Dublin PhD Award and the Horizon Europe Framework Program under grant agreement 101070109.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Disclosure of Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Li, X., Jalan, P., Dingliana, J. (2025). A Tangible Interface for Creating Virtual Cutaways in Mixed Reality. In: Reyes-Lecuona, A., et al. Virtual Reality and Mixed Reality. EuroXR 2024. Lecture Notes in Computer Science, vol 15445. Springer, Cham. https://doi.org/10.1007/978-3-031-78593-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-78593-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-78592-4
Online ISBN: 978-3-031-78593-1
eBook Packages: Computer ScienceComputer Science (R0)