Visual Attention in Extended Reality and Implications for Aviation Safety

• Alexander, A.L., Kaber, D.B., Kim, S.-H., Stelzer, E.M., Kaufmann, K., Prinzel, L.J.: Measurement and modeling of display clutter in advanced flight deck technologies. Int. J. Aviat. Psychol. 22(4), 299–318 (2012)

  Article  Google Scholar 

• Aoki, H., Oman, C.M., Buckland, D.A., Natapoff, A.: Desktop-VR system for preflight 3D navigation training. Acta Astronautic 63(7–10), 841–847 (2008)

  Article  Google Scholar 

• Azuma, R.T.: A survey of Augmented Reality. Presence Teleoper. Virtual Environ. 6(4), 355–385 (1997)

  Article  Google Scholar 

• Ball, K., Owsley, C., Sloane, M.E., Roenker, D.L., Bruni, J.R.: Visual attention problems as a predictor of vehicle crashes in older drivers. Invest. Ophthalmol. Vis. Sci. 34(11), 3110–3123 (1993)

  Google Scholar 

• Ball, K.K., Beard, B.L., Roenker, D.L., Miller, R.L., Griggs, D.S.: Age and visual search: expanding the useful field of view. J. Opt. Soc. Am. A 5(12), 2210 (1988)

  Article  Google Scholar 

• Bagassi, S., De Crescenzio, F., Lucchi, F., Masotti, N.: Augmented and virtual reality in the airport control tower. In: 30th Congress of the International Council of the Aeronautical Sciences (2016)

  Google Scholar 

• Broman, A.T., West, S.K., Muñoz, B., Bandeen-Roche, K., Rubin, G.S., Turano, K.A.: Divided visual attention as a predictor of bumping while walking: the salisbury eye evaluation. Investig. Ophthalmol. Vis. Sci. 45(9), 2955–2960 (2004)

  Article  Google Scholar 

• Borgen, K.B., Ropp, T.D., Weldon, W.T.: Assessment of augmented reality technology’s impact on speed of learning and task performance in aeronautical engineering technology education. Int. J. Aerosp. Psychol. 31(3), 219–229 (2021)

  Article  Google Scholar 

• Carrasco, M.: Visual attention: the past 25 years. Vision. Res. 51(13), 1484–1525 (2011)

  Article  Google Scholar 

• Carrasco, M., Chang, I.: The interaction of objective and subjective organizations in a localization search task. Percept. Psychophys. 57(8), 1134–1150 (1995)

  Article  Google Scholar 

• Carrasco, M., Frieder, K.S.: Cortical magnification neutralizes the eccentricity effect in visual search. Vision Res. 37(1), 63–82 (1997)

  Article  Google Scholar 

• Choi, H., Lane, S.A.: Impact of visuospatial characteristics of video games on improvements in cognitive abilities. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 57, no. 1, pp. 1735–1739 (2013)

  Google Scholar 

• Ellis, S.R., et al.: Augmented reality in a simulated tower environment: effect of field of view on aircraft detection. NASA TM-2002-211853 (2002)

  Google Scholar 

• Eschen, H., Kötter, T., Rodeck, R., Harnisch, M., Schüppstuhl, T.: Augmented and virtual reality for inspection and maintenance processes in the aviation industry. Procedia Manuf. 19, 156–163 (2018)

  Article  Google Scholar 

• Fadden, S., Ververs, P. M., Wickens, C. D.: Costs and benefits of head-up display use: a meta-analytic approach. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, no. 1, pp. 16–20 (1998)

  Google Scholar 

• Fadden, S., Wickens, C., Ververs, P.: Costs and benefits of head up displays - an attention perspective and a meta-analysis. SAE Trans. 109, 1112–1117 (2000)

  Google Scholar 

• Fan, J., McCandliss, B.D., Sommer, T., Raz, A., Posner, M.I.: Testing the efficiency and independence of attentional networks. J. Cogn. Neurosci. 14(3), 340–347 (2002)

  Article  Google Scholar 

• Feng, J., Craik, F.I.M., Levine, B., Moreno, S., Naglie, G., Choi, H.: Differential age-related changes in localizing a target among distractors across an extended visual field. Eur. J. Ageing 14(2), 167–177 (2017). https://doi.org/10.1007/s10433-016-0399-7

  Article  Google Scholar 

• Feng, J., Spence, I.: Upper visual field advantage in localizing a target among distractors. i-Perception 5(2), 97–100 (2014). https://doi.org/10.1068/i0625rep

• Gabbard, J.L., Mehra, D.G., Swan, J.E.: Effects of AR display context switching and focal distance switching on human performance. IEEE Trans. Visual Comput. Graphics 25(6), 2228–2241 (2019)

  Article  Google Scholar 

• Garcia, A. D., Schlueter, J., Paddock, E.: Training astronauts using hardware-in-the-loop simulations and virtual reality. In: AIAA Scitech 2020 Forum, p. 0167 (2020)

  Google Scholar 

• Green, C.S., Bavelier, D.: Effect of action video games on the spatial distribution of visuospatial attention. J. Exp. Psychol. Hum. Percept. Perform. 32(6), 1465 (2006)

  Article  Google Scholar 

• Hassan, S.E., Turano, K.A., Muñoz, B., Munro, C., Roche, K.B., West, S.K.: Cognitive and vision loss affects the topography of the attentional visual field. Investig. Ophthalmol. Vis. Sci. 49(10), 4672–4678 (2008)

  Article  Google Scholar 

• Hebert Jr., T.: The impacts of using augmented reality to support aircraft maintenance. Air Force Institute of Technology Wright-Patterson AFB OH Wright-Patterson AFB United States (2019)

  Google Scholar 

• Hincapie, M., Caponio, A., Rios, H., Gonzalez Mendivil, E.: An introduction to augmented reality with applications in aeronautical maintenance. In: 13th International Conference on Transparent Optical Networks, pp. 1–4 (2011)

  Google Scholar 

• Hofmann, T., König, C., Bruder, R., Bergner, J.: How to reduce workload – augmented reality to ease the work of air traffic controllers. Work 41, 1168–1173 (2012)

  Article  Google Scholar 

• Kaplan, A.D., Cruit, J., Endsley, M., Beers, S.M., Sawyer, B.D., Hancock, P.A.: The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: a meta-analysis. Hum. Factors: J. Hum. Factors Ergon. Soc. 63(4), 706–726 (2021)

  Article  Google Scholar 

• Key, K., et al.: Preliminary findings: Application of maintenance instructions displayed in augmented reality. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2022. LNCS, vol. 13318, pp. 221–232. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-06015-1_16

  Chapter  Google Scholar 

• Lallai, G., Loi Zedda, G., Martinie, C., Palanque, P., Pisano, M., Spano, L.D.: Engineering task-based augmented reality guidance: application to the training of aircraft flight procedures. Interact. Comput. 33(1), 17–39 (2021)

  Article  Google Scholar 

• Lee, Y., Marks, S., Connor, A.M.: An evaluation of the effectiveness of virtual reality in Air Traffic Control. In: Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations, pp. 7–17. Association for Computing Machinery, Sydney (2020)

  Google Scholar 

• Loftin, R.B.: Virtual Environments for aerospace training. In: Proceedings of WESCON 1994, pp. 384–387. IEEE (1994)

  Google Scholar 

• Masotti, N., De Crescenzio, F., Bagassi, S.: Augmented reality in the control tower: a rendering pipeline for multiple head-tracked head-up displays. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9768, pp. 321–338. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40621-3_23

  Chapter  Google Scholar 

• Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D, 1321–1329 (1994)

  Google Scholar 

• Mitchell, D., Choi, H.: Assessing the spatial distribution of visual attention in a virtual environment: development and validation of a novel VR-based attentional visual field (AVF) task. In: CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1–7 (2022)

  Google Scholar 

• Mitchell, D.T., Leibman, D., Choi, H.S.: Development and validation of extended reality attentional visual field tasks. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 66, no. 1, pp. 1992–1996 (2022)

  Google Scholar 

• Mori, S., Ikeda, S., Saito, H.: A survey of diminished reality: techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Trans. Comput. Vision Appl. 9(1), 1–14 (2017). https://doi.org/10.1186/s41074-017-0028-1

  Article  Google Scholar 

• Murph, I., et al.: Diminishing reality: potential benefits and risks. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 65, no. 1, pp. 164–168 (2021)

  Google Scholar 

• Newton, D.C.: Human factors considerations for head-worn displays in civil aviation. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2022. Lecture Notes in Computer Science, vol. 13318, pp. 233–250. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-06015-1_17

  Chapter  Google Scholar 

• Olbrich, M., Graf, H., Keil, J., Gad, R., Bamfaste, S., Nicolini, F.: Virtual reality based space operations – a study of ESA’s potential for VR based training and simulation. In: Chen, J., Fragomeni, G. (eds.) VAMR 2018. LNCS, vol. 10909, pp. 438–451. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91581-4_33

  Chapter  Google Scholar 

• Owsley, C., Ball, K., Keeton, D.M.: Relationship between visual sensitivity and target localization in older adults. Vision. Res. 35(4), 579–587 (1995)

  Article  Google Scholar 

• Piechowski, S., et al.: Virtual reality as training aid for Manual spacecraft docking. Acta Astronaut. 177, 731–736 (2020)

  Article  Google Scholar 

• Posner, M.I., Rothbart, M.K.: Research on attention networks as a model for the integration of psychological science. Annu. Rev. Psychol. 58(1), 1–23 (2007)

  Article  Google Scholar 

• Posner, M.I., Peterson, S.E.: The attention system of the human brain. Attent. Soc. World 13, 25–42 (1990)

  Google Scholar 

• Prinzel, L.J, Risser, M.: Head up displays and attention capture. Tech. Memo. No. NASA TM-2004-21300, NASA Langley Research Center, Langley, VA (2004)

  Google Scholar 

• Raz, A., Buhle, J.: Typologies of attentional networks. Nat. Rev. Neurosci. 7, 367–379 (2006)

  Article  Google Scholar 

• Reisman, R., Brown, D.: Design of augmented reality tools for air traffic control towers. In: 6th AIAA Aviation Technology, Integration and Operations Conference (ATIO) (2006)

  Google Scholar 

• Safi, M., Chung, J., Pradhan, P.: Review of augmented reality in aerospace industry. Aircr. Eng. Aerosp. Technol. 91(9), 1194–1197 (2019)

  Google Scholar 

• Spence, I., Feng, J.: Video games and spatial cognition. Rev. Gen. Psychol. 14(2), 92–104 (2010)

  Article  Google Scholar 

• Stone, R.J., Panfilov, P.B., Shukshunov, V.E.: Evolution of aerospace simulation: from immersive virtual reality to serious games. In: Proceedings of 5th International Conference on Recent Advances in Space Technologies, pp. 655–662. IEEE (2011)

  Google Scholar 

• Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative effectiveness of Augmented Reality in Object Assembly. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 73–80 (2003)

  Google Scholar 

• Ververs, P.M., Wickens, C.D.: Head-up displays: effect of clutter, display intensity, and display location on pilot performance. Int. J. Aviat. Psychol. 8(4), 377–403 (1998)

  Article  Google Scholar 

• Wang, X., Ong, S.K., Nee, A.Y.C.: Multi-modal augmented-reality assembly guidance based on bare-hand interface. Adv. Eng. Inform. 30(3), 406–421 (2016)

  Article  Google Scholar 

• Wickens, C.: Attention: Theory, principles, models and applications. Int. J. Hum.-Comput. Interact. 37(5), 403–417 (2021)

  Article  Google Scholar 

Download references