Abstract
From words, images, films to games, the development of narrative is inseparable from the evolution of media. With the advent of virtual reality, the traditional paradigms of storytelling need to be expanded. VR can simulate the real world vividly to an unprecedented extent, in which users can choose their own perspectives freely during their exploration. However, in addition to great immersion and presence, this powerful new technology also brings new challenges to interactive storytellers who are familiar with the traditional “frame-bound” media. To keep users focused on the storyline efficiently and naturally in VR, new ways of perceptual cues need to be explored and verified. Through a comparative experiment, we tested how well the existing perceptual cues could meet our expectations using “Secondary Mission”, an original interactive narrative VR game, as a case for study. Based on our findings, design strategies for planning perceptual cues in VR interactive narratives were proposed to help in improving users’ experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Murray, J.H.: Research into interactive digital narrative: a kaleidoscopic view. In: Rouse, R., Koenitz, H., Haahr, M. (eds.) ICIDS 2018. LNCS, vol. 11318, pp. 3–17. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_1
Desurvire, H., Kreminski, M.: Are game design and user research guidelines specific to virtual reality effective in creating a more optimal player experience? Yes, VR PLAY. In: Marcus, A., Wang, W. (eds.) DUXU 2018. LNCS, vol. 10918, pp. 40–59. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91797-9_4
Ko, D.-U., Ryu, H., Kim, J.: Making new narrative structures with actor’s eye-contact in cinematic virtual reality (CVR). In: Rouse, R., Koenitz, H., Haahr, M. (eds.) ICIDS 2018. LNCS, vol. 11318, pp. 343–347. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04028-4_38
Brillhart, J.: The language of VR (2016)
Nielsen, L.T., et al.: Missing the point: an exploration of how to guide users’ attention during cinematic virtual reality. In: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, pp. 229–232, November 2016
Zhao, Q.: A survey on virtual reality. Sci. China Ser. F Inf. Sci. 52(3), 348–400 (2009)
Riedl, M.O., Bulitko, V.: Interactive narrative: an intelligent systems approach. AI Mag. 34(1), 67 (2013)
Koenitz, H.: Five theses for interactive digital narrative. In: Mitchell, A., Fernández-Vara, C., Thue, D. (eds.) ICIDS 2014. LNCS, vol. 8832, pp. 134–139. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-12337-0_13
Pillai, J.S., Verma, M.: Grammar of VR storytelling: analysis of perceptual cues in VR cinema. In: European Conference on Visual Media Production, pp. 1–10 (2019)
Chen, T., Wu, Y.S., Zhu, K.: Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, pp. 1–5, November 2018
Lescop, L.: Narrative grammar in 360. In: 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), pp. 254–257. IEEE, October 2017
Marples, D.: The influence of intrinsic perceptual cues on navigation and route selection in virtual environments (Doctoral dissertation, University of Huddersfield) (2017)
Xu, Y., et al.: Gaze prediction in dynamic 360 immersive videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5333–5342 (2018)
El-Nasr, M.S., Yan, S.: Visual attention in 3D video games. In: Proceedings of the 2006 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 22–es, June 2016
Way, T.P., Barner, K.E.: Automatic visual to tactile translation. I. human factors, access methods and image manipulation. IEEE Trans. Rehabil. Eng. 5(1), 81–94 (1997)
Nagy, A.L., Sanchez, R.R.: Critical color differences determined with a visual search task. JOSA A 7(7), 1209–1217 (1990)
Wolfe, J.M., Myers, L.: Fur in the midst of the waters: visual search for material type is inefficient. J. Vis. 10(9), 8 (2010)
Chun, M.M., Wolfe, J.M.: Visual attention. Blackwell handbook of perception, 272310 (2001)
Li, Y.M., Joo, J.W.: The change of animation narrative structure caused by virtual reality technology. J. Digit. Contents Soc. 20(3), 459–467 (2019)
Kunar, M.A., Watson, D.G.: Visual search in a multi-element asynchronous dynamic (MAD) world. J. Exp. Psychol. Hum. Percept. Perform. 37(4), 1017 (2011)
Pillai, J.S., Ismail, A., Charles, H.P.: Grammar of VR storytelling: visual cues. In: Proceedings of the Virtual Reality International Conference-Laval Virtual 2017, pp. 1–4, March 2017
Frischen, A., Eastwood, J.D., Smilek, D.: Visual search for faces with emotional expressions. Psychol. Bull. 134(5), 662 (2008)
Cockburn, A., Brewster, S.: Multimodal feedback for the acquisition of small targets. Ergonomics 48(9), 1129–1150 (2005)
Dillman, K.R., Mok, T.T.H., Tang, A., Oehlberg, L., Mitchell, A.: A visual interaction cue framework from video game environments for augmented reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12, April 2018
Wolfe, J.M., Horowitz, T.S.: Five factors that guide attention in visual search. Nat. Hum. Behav. 1(3), 1–8 (2017)
Chen, T., Wu, Y.S., Zhu, K.: Investigating different modalities of directional cues for multi-task visual-searching scenario in virtual reality. In: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, pp. 1–5, November 2018
Roth, C., Vorderer, P., Klimmt, C.: The motivational appeal of interactive storytelling: towards a dimensional model of the user experience. In: Iurgel, I.A., Zagalo, N., Petta, P. (eds.) ICIDS 2009. LNCS, vol. 5915, pp. 38–43. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-10643-9_7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
He, E., Lin, J., Liu, Z., Zhang, Y. (2021). Research on Perceptual Cues of Interactive Narrative in Virtual Reality. In: Yamamoto, S., Mori, H. (eds) Human Interface and the Management of Information. Information Presentation and Visualization. HCII 2021. Lecture Notes in Computer Science(), vol 12765. Springer, Cham. https://doi.org/10.1007/978-3-030-78321-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-78321-1_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78320-4
Online ISBN: 978-3-030-78321-1
eBook Packages: Computer ScienceComputer Science (R0)