More Web Proxy on the site http://driver.im/

research-article

How Should Automated Vehicles Communicate Critical Situations?: A Comparative Analysis of Visualization Concepts

Authors:

Enrico RukzioAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 5, Issue 3

Article No.: 94, Pages 1 - 23

https://doi.org/10.1145/3478111

Published: 14 September 2021 Publication History

Abstract

Passengers of automated vehicles will likely engage in non-driving related activities like reading and, therefore, be disengaged from the driving task. However, especially in critical situations such as unexpected pedestrian crossings, it can be assumed that passengers request information about the vehicle's intention and an explanation. Some concepts were proposed for such communication from the automated vehicle to the passenger. However, results are not comparable due to varying information content and scenarios. We present a comparative study in Virtual Reality (N=20) of four visualization concepts and a baseline with Augmented Reality, a Head-Up Display, or Lightbands. We found that all concepts were rated reasonable and necessary and increased trust, perceived safety, perceived intelligence, and acceptance compared to no visualization. However, when visualizations were compared, there were hardly any significant differences between them.

Supplementary Material

colley (colley.zip)

Supplemental movie, appendix, image and software files for, How Should Automated Vehicles Communicate Critical Situations?: A Comparative Analysis of Visualization Concepts

Download
94.87 MB

References

[1]

Lotfi Abdi, Faten Ben Abdallah, and Aref Meddeb. 2015. In-vehicle augmented reality traffic information system: a new type of communication between driver and vehicle. Procedia Computer Science 73 (2015), 242--249.

[2]

Lotfi Abdi and Aref Meddeb. 2018. Driver information system: a combination of augmented reality, deep learning and vehicular Ad-hoc networks. Multimedia Tools and Applications 77, 12 (2018), 14673--14703.

Digital Library

[3]

Continental AG. 2013. Continental Mobility Study 2013. https://www.continental.com/resource/blob/7380/6cddc571cd3d3b5cacd279fe0d1a00c1/mobistud-2013-dl-data.pdf. [Online; accessed: 07-DECEMBER-2019].

[4]

Patrícia RJA Alves, Joel Gonçalves, Rosaldo JF Rossetti, Eugénio C Oliveira, and Cristina Olaverri-Monreal. 2013. Forward collision warning systems using heads-up displays: Testing usability of two new metaphors. In 2013 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops). IEEE, IEEE, New York, NY, USA, 1--6.

[5]

Karlin Bark, Cuong Tran, Kikuo Fujimura, and Victor Ng-Thow-Hing. 2014. Personal Navi: Benefits of an Augmented Reality Navigational Aid Using a See-Thru 3D Volumetric HUD. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seattle, WA, USA) (AutomotiveUI '14). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/2667317.2667329

Digital Library

[6]

Christoph Bartneck, Dana Kulić, Elizabeth Croft, and Susana Zoghbi. 2009. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. International Journal of Social Robotics 1, 1 (2009), 71--81. https://doi.org/10.1007/s12369-008-0001-3

[7]

Kassandra Bauerfeind, Julia Drüke, Lennart Bendewald, and Martin Baumann. 2018. When does the driver benefit from AR-information in a navigation task compared to a Head-Up Display? Results of a driving simulator study.

[8]

U Bergmeier and Christian Lange. 2008. Acceptance of Augmented Reality for driver assistance information.

[9]

Shadan Sadeghian Borojeni, Lewis Chuang, Wilko Heuten, and Susanne Boll. 2016. Assisting Drivers with Ambient Take-Over Requests in Highly Automated Driving. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (Automotive'UI 16). Association for Computing Machinery, New York, NY, USA, 237--244. https://doi.org/10.1145/3003715.3005409

Digital Library

[10]

John Brooke et al. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.

[11]

Kar-Hai Chu, Robert Brewer, and Sam Joseph. 2008. Traffic and navigation support through an automobile heads up display (a-HUD).

[12]

Mark Colley, Christian Bräuner, Mirjam Lanzer, Marcel Walch, Martin Baumann, and Enrico Rukzio. 2020. Effect of Visualization of Pedestrian Intention Recognition on Trust and Cognitive Load. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI '20). ACM, Association for Computing Machinery, New York, NY, USA, 181--191. https://doi.org/10.1145/3409120.3410648

Digital Library

[13]

Mark Colley, Benjamin Eder, Jan Ole Rixen, and Enrico Rukzio. 2021. Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445351

Digital Library

[14]

Daniel Damböck, Thomas Weißgerber, Martin Kienle, and Klaus Bengler. 2012. Evaluation of a contact analog head-up display for highly automated driving. In 4th International Conference on Applied Human Factors and Ergonomics. Citeseer, CRC Press, San Francisco CA, USA, 6011--6020.

[15]

Henrik Detjen, Stefan Geisler, and Stefan Schneegass. 2020. "Help, Accident Ahead!": Using Mixed Reality Environments in Automated Vehicles to Support Occupants After Passive Accident Experiences. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI '20). Association for Computing Machinery, New York, NY, USA, 58--61. https://doi.org/10.1145/3409251.3411723

Digital Library

[16]

Na Du, Jacob Haspiel, Qiaoning Zhang, Dawn Tilbury, Anuj K. Pradhan, X. Jessie Yang, and Lionel P. Robert. 2019. Look who's talking now: Implications of AV's explanations on driver's trust, AV preference, anxiety and mental workload. Transportation Research Part C: Emerging Technologies 104 (2019), 428--442. https://doi.org/10.1016/j.trc.2019.05.025 ID: 271729.

[17]

Marc Dziennus, Johann Kelsch, and Anna Schieben. 2016. Ambient light based interaction concept for an integrative driver assistance system-a driving simulator study., 171--182 pages.

[18]

Joep Eijkemans. 2019. Motion sickness in a Virtual Reality cycling simulation. http://essay.utwente.nl/78690/

[19]

Stefanie M. Faas, Andrea C. Kao, and Martin Baumann. 2020. A Longitudinal Video Study on Communicating Status and Intent for Self-Driving Vehicle - Pedestrian Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376484

Digital Library

[20]

Daniel J Fagnant and Kara Kockelman. 2015. Preparing a nation for autonomous vehicles: opportunities, barriers and policy recommendations. Transportation Research Part A: Policy and Practice 77 (2015), 167--181.

[21]

Franz Faul, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. 2009. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior research methods 41, 4 (2009), 1149--1160.

[22]

Yannick Forster, Johannes Kraus, Sophie Feinauer, and Martin Baumann. 2018. Calibration of Trust Expectancies in Conditionally Automated Driving by Brand, Reliability Information and Introductionary Videos: An Online Study. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI '18). Association for Computing Machinery, New York, NY, USA, 118--128. https://doi.org/10.1145/3239060.3239070

Digital Library

[23]

Anna-Katharina Frison, Philipp Wintersberger, Andreas Riener, Clemens Schartmüller, Linda Ng Boyle, Erika Miller, and Klemens Weigl. 2019. In UX We Trust: Investigation of Aesthetics and Usability of Driver-Vehicle Interfaces and Their Impact on the Perception of Automated Driving. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300374

Digital Library

[24]

David C. Funder and Daniel J. Ozer. 2019. Evaluating Effect Size in Psychological Research: Sense and Nonsense. Advances in Methods and Practices in Psychological Science 2, 2 (2019), 156--168. https://doi.org/10.1177/2515245919847202 arXiv:https://doi.org/10.1177/2515245919847202

[25]

J. L. Gabbard, G. M. Fitch, and H. Kim. 2014. Behind the Glass: Driver Challenges and Opportunities for AR Automotive Applications. Proc. IEEE 102, 2 (2014), 124--136.

[26]

Joseph L. Gabbard, Missie Smith, Kyle Tanous, Hyungil Kim, and Bryan Jonas. 2019. AR DriveSim: An Immersive Driving Simulator for Augmented Reality Head-Up Display Research. Frontiers in Robotics and AI 6 (2019), 98. https://doi.org/10.3389/frobt.2019.00098

[27]

Paul George, Indira Thouvenin, Vincent Fremont, and Véronique Cherfaoui. 2012. DAARIA: Driver assistance by augmented reality for intelligent automobile. In 2012 IEEE Intelligent Vehicles Symposium. IEEE, IEEE, New York, NY, USA, 1043--1048.

[28]

Renate Haeuslschmid, Bastian Pfleging, and Florian Alt. 2016. A Design Space to Support the Development of Windshield Applications for the Car. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 5076--5091. https://doi.org/10.1145/2858036.2858336

Digital Library

[29]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, Amsterdam, The Netherlands, 139--183.

[30]

Renate Häuslschmid, Sven Osterwald, Marcus Lang, and Andreas Butz. 2015. Augmenting the Driver's View with Peripheral Information on a Windshield Display. In Proceedings of the 20th International Conference on Intelligent User Interfaces (Atlanta, Georgia, USA) (IUI '15). Association for Computing Machinery, New York, NY, USA, 311--321. https://doi.org/10.1145/2678025.2701393

Digital Library

[31]

Renate Häuslschmid, Donghao Ren, Florian Alt, Andreas Butz, and Tobias Höllerer. 2019. Personalizing content presentation on large 3d head-up displays. PRESENCE: Virtual and Augmented Reality 27, 1 (2019), 80--106.

Digital Library

[32]

Renate Häuslschmid, Max von Bülow, Bastian Pfleging, and Andreas Butz. 2017. Supporting Trust in Autonomous Driving. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (Limassol, Cyprus) (IUI '17). Association for Computing Machinery, New York, NY, USA, 319--329. https://doi.org/10.1145/3025171.3025198

Digital Library

[33]

Philipp Hock, Johannes Kraus, Marcel Walch, Nina Lang, and Martin Baumann. 2016. Elaborating Feedback Strategies for Maintaining Automation in Highly Automated Driving. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (Automotive'UI 16). Association for Computing Machinery, New York, NY, USA, 105--112. https://doi.org/10.1145/3003715.3005414

Digital Library

[34]

Kevin Anthony Hoff and Masooda Bashir. 2015. Trust in automation: Integrating empirical evidence on factors that influence trust. Human factors 57, 3 (2015), 407--434.

[35]

Amin Hosseini, Daniel Bacara, and Markus Lienkamp. 2014. A system design for automotive augmented reality using stereo night vision. In 2014 IEEE Intelligent Vehicles Symposium Proceedings. IEEE, IEEE, New York, NY, USA, 127--133.

[36]

Xiaojun Hu, Ronald Rousseau, and Jin Chen. 2011. On the definition of forward and backward citation generations. Journal of Informetrics 5, 1 (2011), 27--36.

[37]

Yoonsook Hwang, Byoung-Jun Park, and Kyong-Ho Kim. 2016. Effects of Augmented-Reality Head-up Display System Use on Risk Perception and Psychological Changes of Drivers. ETRI Journal 38, 4 (2016), 757--766.

[38]

A Cecile JW Janssens, Marta Gwinn, J Elaine Brockman, Kimberley Powell, and Michael Goodman. 2020. Novel citation-based search method for scientific literature: a validation study. BMC medical research methodology 20, 1 (2020), 25.

[39]

Satish Jeyachandran. 2020. Introducing the 5th-generation Waymo Driver: Informed by experience, designed for scale, engineered to tackle more environments. https://blog.waymo.com/2020/03/introducing-5th-generation-waymo-driver.html [Online; accessed 24-MARCH-2020].

[40]

Jiun-Yin Jian, Ann M Bisantz, and Colin G Drury. 2000. Foundations for an empirically determined scale of trust in automated systems. International Journal of Cognitive Ergonomics 4, 1 (2000), 53--71.

[41]

Richie Jose, Gun A. Lee, and Mark Billinghurst. 2016. A Comparative Study of Simulated Augmented Reality Displays for Vehicle Navigation. In Proceedings of the 28th Australian Conference on Computer-Human Interaction (Launceston, Tasmania, Australia) (OzCHI '16). Association for Computing Machinery, New York, NY, USA, 40--48. https://doi.org/10.1145/3010915.3010918

Digital Library

[42]

Takaya Kawamata, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta. 2013. Poster: Lifted road map view on windshield display. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, IEEE, New York, NY, USA, 139--140.

[43]

Juela Kazazi, Susann Winkler, and Mark Vollrath. 2015. Accident prevention through visual warnings: how to design warnings in head-up display for older and younger drivers. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems. IEEE, IEEE, New York, NY, USA, 1028--1034.

Digital Library

[44]

Jinkyu Kim and John Canny. 2017. Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention. In The IEEE International Conference on Computer Vision (ICCV). IEEE, New York, NY, USA, 2961--2969. https://doi.org/10.1109/ICCV.2017.320

[45]

Naeun Kim, Kwangmin Jeong, Minyoung Yang, Yejeon Oh, and Jinwoo Kim. 2017. "Are You Ready to Take-over?": An Exploratory Study on Visual Assistance to Enhance Driver Vigilance. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI EA '17). Association for Computing Machinery, New York, NY, USA, 1771--1778. https://doi.org/10.1145/3027063.3053155

Digital Library

[46]

SeungJun Kim and Anind K. Dey. 2009. Simulated Augmented Reality Windshield Display as a Cognitive Mapping Aid for Elder Driver Navigation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI '09). Association for Computing Machinery, New York, NY, USA, 133--142. https://doi.org/10.1145/1518701.1518724

[47]

Kazuhiro Kojima, Akihiko Sato, Fumihiro Taya, Yoshinari Kameda, and Yuichi Ohta. 2005. NaviView: visual assistance by virtual mirrors at blind intersection. In Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005. IEEE, IEEE, New York, NY, USA, 592--597.

[48]

Jeamin Koo, Jungsuk Kwac, Wendy Ju, Martin Steinert, Larry Leifer, and Clifford Nass. 2015. Why did my car just do that? Explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 4 (2015), 269--275.

[49]

Moritz Körber. 2019. Theoretical Considerations and Development of a Questionnaire to Measure Trust in Automation. In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018), Sebastiano Bagnara, Riccardo Tartaglia, Sara Albolino, Thomas Alexander, and Yushi Fujita (Eds.). Springer International Publishing, Cham, 13--30.

[50]

Oswald Kothgassner, A Felnhofer, N Hauk, E Kastenhofer, J Gomm, and I Krysprin-Exner. 2013. Technology Usage Inventory. https://www.ffg.at/sites/default/files/allgemeine_downloads/thematische%20programme/programmdokumente/tui_manual.pdf. Manual. Wien: ICARUS 17, 04 (2013), 90. [Online; accessed: 05-JULY-2020].

[51]

Johannes Kraus, David Scholz, Dina Stiegemeier, and Martin Baumann. 0. The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency. Human Factors 0, 0 (0), 0018720819853686. https://doi.org/10.1177/0018720819853686 arXiv:https://doi.org/10.1177/0018720819853686 31233695.

[52]

Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2018. Augmented Reality Displays for Communicating Uncertainty Information in Automated Driving. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI '18). Association for Computing Machinery, New York, NY, USA, 164--175. https://doi.org/10.1145/3239060.3239074

Digital Library

[53]

Alexander Kunze, Stephen J. Summerskill, Russell Marshall, and Ashleigh J. Filtness. 2019. Conveying Uncertainties Using Peripheral Awareness Displays in the Context of Automated Driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI '19). Association for Computing Machinery, New York, NY, USA, 329--341. https://doi.org/10.1145/3342197.3344537

Digital Library

[54]

Sui Kurihashi, Yutaka Matsuno, and Kenji Tanaka. 2014. Evaluation of a mutual assistance system from both the recipient and assister sides. In 2014 Proceedings of the SICE Annual Conference (SICE). IEEE, IEEE, New York, NY, USA, 1702--1707.

[55]

Miltos Kyriakidis, Riender Happee, and Joost CF de Winter. 2015. Public opinion on automated driving: Results of an international questionnaire among 5000 respondents. Transportation research part F: traffic psychology and behaviour 32 (2015), 127--140.

[56]

Patrick Lindemann, Tae-Young Lee, and Gerhard Rigoll. 2018. Catch my drift: Elevating situation awareness for highly automated driving with an explanatory windshield display user interface. Multimodal Technologies and Interaction 2, 4 (2018), 71.

[57]

Patrick Lindemann, Niklas Müller, and Gerhard Rigolll. 2019. Exploring the Use of Augmented Reality Interfaces for Driver Assistance in Short-Notice Takeovers. In 2019 IEEE Intelligent Vehicles Symposium (IV). IEEE, IEEE, New York, NY, USA, 804--809.

[58]

Andreas Löcken, Anna-Katharina Frison, Vanessa Fahn, Dominik Kreppold, Maximilian Götz, and Andreas Riener. 2020. Increasing User Experience and Trust in Automated Vehicles via an Ambient Light Display. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI '20). Association for Computing Machinery, New York, NY, USA, Article 38, 10 pages. https://doi.org/10.1145/3379503.3403567

Digital Library

[59]

Andreas Löcken, Wilko Heuten, and Susanne Boll. 2015. Supporting Lane Change Decisions with Ambient Light. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Nottingham, United Kingdom) (AutomotiveUI '15). Association for Computing Machinery, New York, NY, USA, 204--211. https://doi.org/10.1145/2799250.2799259

Digital Library

[60]

Andreas Löcken, Wilko Heuten, and Susanne Boll. 2016. AutoAmbiCar: Using Ambient Light to Inform Drivers About Intentions of Their Automated Cars. In Adjunct Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (AutomotiveUI '16 Adjunct). Association for Computing Machinery, New York, NY, USA, 57--62. https://doi.org/10.1145/3004323.3004329

Digital Library

[61]

Andreas Löcken, Heiko Müller, Wilko Heuten, and Susanne Boll. 2015. An experiment on ambient light patterns to support lane change decisions. In 2015 IEEE Intelligent Vehicles Symposium (IV). IEEE, IEEE, New York, NY, USA, 505--510.

[62]

Tania Lombrozo. 2007. Simplicity and probability in causal explanation. Cognitive psychology 55, 3 (2007), 232--257.

[63]

Lutz Lorenz, Philipp Kerschbaum, and Josef Schumann. 2014. Designing take over scenarios for automated driving: How does augmented reality support the driver to get back into the loop?, In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58, 1, 1681--1685. https://doi.org/10.1177/1541931214581351 arXiv:https://doi.org/10.1177/1541931214581351

[64]

Franz Mader. 2004. Entwurf und Integration eines kamerabasierten Trackingsystems fr ein Flugzeugcockpit zur Darstellung fortschrittlicher Flugfhrungsinformationen in einem Head-Mounted Display. Ph.D. Dissertation. Diplomarbeit, Fakultät für Informatik, Technische Universität München.

[65]

Andrii Matviienko, Andreas Löcken, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2016. NaviLight: Investigating Ambient Light Displays for Turn-by-Turn Navigation in Cars. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI'16). Association for Computing Machinery, New York, NY, USA, 283--294. https://doi.org/10.1145/2935334.2935359

Digital Library

[66]

Zeljko Medenica, Andrew L. Kun, Tim Paek, and Oskar Palinko. 2011. Augmented Reality vs. Street Views: A Driving Simulator Study Comparing Two Emerging Navigation Aids. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (Stockholm, Sweden) (MobileHCI '11). Association for Computing Machinery, New York, NY, USA, 265--274. https://doi.org/10.1145/2037373.2037414

Digital Library

[67]

Toru Miyamoto, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta. 2006. Floating Virtual Mirrors: Visualization of the Scene Behind a Vehicle. In Advances in Artificial Reality and Tele-Existence, Zhigeng Pan, Adrian Cheok, Michael Haller, Rynson W. H. Lau, Hideo Saito, and Ronghua Liang (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 302--313.

[68]

Bonnie M Muir and Neville Moray. 1996. Trust in automation. Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics 39, 3 (1996), 429--460.

[69]

Wolfgang Narzt, Gustav Pomberger, Alois Ferscha, Dieter Kolb, M Reiner, Jan Wieghardt, H Horst, Christopher Lindinger, et al. 2003. Pervasive information acquisition for mobile AR-navigation systems. In null. IEEE, IEEE, New York, NY, USA, 13.

[70]

Victor Ng-Thow-Hing, Karlin Bark, Lee Beckwith, Cuong Tran, Rishabh Bhandari, and Srinath Sridhar. 2013. User-centered perspectives for automotive augmented reality. In IEEE International Symposium on Mixed and Augmented Reality. IEEE, New York, NY, USA, 13--22.

[71]

NTSB. 2017. NTSB/HAR-17/02 PB2017-102600. Technical Report. National Transportation Safety Board.

[72]

Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use, misuse, disuse, abuse. Human factors 39, 2 (1997), 230--253.

[73]

Byoung-Jun Park, Jeong-Woo Lee, Changrak Yoon, and Kyong-Ho Kim. 2015. Augmented reality and representation in vehicle for safe driving at night. In 2015 International Conference on Information and Communication Technology Convergence (ICTC). IEEE, IEEE, New York, NY, USA, 1261--1263.

[74]

Hye Sun Park, Min Woo Park, Kwang Hee Won, Kyong-Ho Kim, and Soon Ki Jung. 2013. In-Vehicle AR-HUD System to Provide Driving-Safety Information. ETRI Journal 35, 6 (2013), 1038--1047. https://doi.org/10.4218/etrij.13.2013.0041 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.4218/etrij.13.2013.0041

[75]

Min Woo Park and Soon Ki Jung. 2014. A projector-based full windshield HUD simulator to evaluate the visualization methods. In 2014 Sixth International Conference on Ubiquitous and Future Networks (ICUFN). IEEE, IEEE, New York, NY, USA, 509--510.

[76]

Indrajeet Patil. 2021. Visualizations with statistical details: The 'ggstatsplot' approach. Journal of Open Source Software 6, 61 (2021), 3167. https://doi.org/10.21105/joss.03167

[77]

Simone Pettigrew, Zenobia Talati, and Richard Norman. 2018. The health benefits of autonomous vehicles: Public awareness and receptivity in Australia. Australian and New Zealand journal of public health 42, 5 (2018), 480--483.

[78]

Lisa Pfannmueller, Martina Kramer, Bernhard Senner, and Klaus Bengler. 2015. A comparison of display concepts for a navigation system in an automotive contact analog head-up display. Procedia Manufacturing 3 (2015), 2722--2729.

[79]

Bastian Pfleging, Maurice Rang, and Nora Broy. 2016. Investigating User Needs for Non-Driving-Related Activities during Automated Driving. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (Rovaniemi, Finland) (MUM '16). Association for Computing Machinery, New York, NY, USA, 91--99. https://doi.org/10.1145/3012709.3012735

Digital Library

[80]

Marina Plavšic, Markus Duschl, Marcus Tönnis, Heiner Bubb, and Gudrun Klinker. 2009. Ergonomic design and evaluation of augmented reality based cautionary warnings for driving assistance in urban environments., 10 pages.

[81]

T. Poitschke, M. Ablassmeier, G. Rigoll, S. Bardins, S. Kohlbecher, and E. Schneider. 2008. Contact-Analog Information Representation in an Automotive Head-up Display In Proceedings of the 2008 Symposium on Eye Tracking Research and Applications (Savannah, Georgia) (ETRA '08). Association for Computing Machinery, New York, NY, USA, 119--122. https://doi.org/10.1145/1344471.1344502

[82]

Akihiko Sato, Itaru Kitahara, Yoshinari Kameda, and Yuichi Ohta. 2006. Visual navigation system on windshield head-up display. In Proc. 13th World Congress on Intelligent Transport Systems, CD-ROM. Intelligent Transport Systems (ITS), Intelligent Transport Systems (ITS), London, UK, 8 pages.

[83]

Jens Sauerbrey. 2004. MAN Abbiegeassistent: Ein System zur Unfallvermeidung beim Rechtsabbiegen von Lkw.

[84]

Jeff Sauro. 2011. Measuring usability with the system usability scale (SUS).

[85]

Michael Simon, Elke Hausner, Susan F Klaus, and Nancy E Dunton. 2010. Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the interface. BMC medical research methodology 10, 1 (2010), 76.

[86]

Missie Smith, Joseph L. Gabbard, and Christian Conley. 2016. Head-Up vs. Head-Down Displays: Examining Traditional Methods of Display Assessment While Driving. In Proceedings of the 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Ann Arbor, MI, USA) (Automotive'UI 16). Association for Computing Machinery, New York, NY, USA, 185--192. https://doi.org/10.1145/3003715.3005419

Digital Library

[87]

Alessandro Soro, Andry Rakotonirainy, Ronald Schroeter, and Sabine Wollstädter. 2014. Using Augmented Video to Test In-Car User Experiences of Context Analog HUDs. In Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seattle, WA, USA) (AutomotiveUI '14). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/2667239.2667302

Digital Library

[88]

Laerd statistics. 2016. Mixed ANOVA using SPSS Statistics. https://statistics.laerd.com/spss-tutorials/mixed-anova-using-spss-statistics.php. [Online; Accessed: 12-SEPTEMBER-2019].

[89]

Krittiya Tangmanee and Sakol Teeravarunyou. 2012. Effects of guided arrows on head-up display towards the vehicle windshield. In 2012 Southeast Asian Network of Ergonomics Societies Conference (SEANES). IEEE, IEEE, New York, NY, USA, 1--6.

[90]

Fumihiro Taya, Yoshinari Kameda, and Yuichi Ohta. 2005. Naviview: Virtual slope visualization of blind area at an intersection., 8 pages.

[91]

Paul Thagard. 1989. Explanatory coherence. Behavioral and brain sciences 12, 3 (1989), 435--502.

[92]

Marcus Tonnis and Gudrun Klinker. 2006. Effective control of a car driver's attention for visual and acoustic guidance towards the direction of imminent dangers. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, IEEE, New York, NY, USA, 13--22.

Digital Library

[93]

Unity Technologies. 2019. Unity. Unity Technologies. https://unity.com/

[94]

Unity Technologies. 2019. Windridge City. Unity Technologies. https://assetstore.unity.com/packages/3d/environments/roadways/windridge-city-132222

[95]

Jinke D Van Der Laan, Adriaan Heino, and Dick De Waard. 1997. A simple procedure for the assessment of acceptance of advanced transport telematics. Transportation Research Part C: Emerging Technologies 5, 1 (1997), 1--10.

[96]

Tamara von Sawitzky, Philipp Wintersberger, Andreas Riener, and Joseph L. Gabbard. 2019. Increasing Trust in Fully Automated Driving: Route Indication on an Augmented Reality Head-up Display. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis '19). Association for Computing Machinery, New York, NY, USA, Article 6, 7 pages. https://doi.org/10.1145/3321335.3324947

Digital Library

[97]

Marcel Walch, Mark Colley, and Michael Weber. 2019. CooperationCaptcha: On-The-Fly Object Labeling for Highly Automated Vehicles. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA '19). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3290607.3313022

[98]

Marcel Walch, Marcel Woide, Kristin Mühl, Martin Baumann, and Michael Weber. 2019. Cooperative Overtaking: Overcoming Automated Vehicles' Obstructed Sensor Range via Driver Help. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI '19). Association for Computing Machinery, New York, NY, USA, 144--155. https://doi.org/10.1145/3342197.3344531

Digital Library

[99]

Rebecca M Warner and David B Sugarman. 1986. Attributions of personality based on physical appearance, speech, and handwriting. Journal of personality and social psychology 50, 4 (1986), 792.

[100]

Florian Weidner and Wolfgang Broll. 2019. Smart S3D TOR: Intelligent Warnings on Large Stereoscopic 3D Dashboards during Take-Overs. In Proceedings of the 8th ACM International Symposium on Pervasive Displays (Palermo, Italy) (PerDis '19). Association for Computing Machinery, New York, NY, USA, Article 5, 7 pages. https://doi.org/10.1145/3321335.3324937

Digital Library

[101]

Annette Werner. 2019. New colours for autonomous driving: An evaluation of chromaticities for the external lighting equipment of autonomous vehicles.

[102]

Gesa Wiegand, Malin Eiband, Maximilian Haubelt, and Heinrich Hussmann. 2020. "I'd like an Explanation for That!"Exploring Reactions to Unexpected Autonomous Driving. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services (Oldenburg, Germany) (MobileHCI '20). Association for Computing Machinery, New York, NY, USA, Article 36, 11 pages. https://doi.org/10.1145/3379503.3403554

Digital Library

[103]

Gesa Wiegand, Christian Mai, Kai Holländer, and Heinrich Hussmann. 2019. InCarAR: A Design Space Towards 3D Augmented Reality Applications in Vehicles. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Utrecht, Netherlands) (AutomotiveUI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3342197.3344539

Digital Library

[104]

Christian A Wiesner, Mike Ruf, Demet Sirim, and Gudrun Klinker. 2017. 3D-FRC: Depiction of the future road course in the Head-Up-Display. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, IEEE, New York, NY, USA, 136--143.

[105]

Marc Wilbrink, Anna Schieben, and Michael Oehl. 2020. Reflecting the Automated Vehicle's Perception and Intention: Light-Based Interaction Approaches for on-Board HMI in Highly Automated Vehicles. In Proceedings of the 25th International Conference on Intelligent User Interfaces Companion (Cagliari, Italy) (IUI '20). Association for Computing Machinery, New York, NY, USA, 105--107. https://doi.org/10.1145/3379336.3381502

Digital Library

[106]

Susann Winkler, Juela Kazazi, and Mark Vollrath. 2015. Distractive or Supportive-How Warnings in the Head-up Display Affect Drivers' Gaze and Driving Behavior. In 2015 IEEE 18th International Conference on Intelligent Transportation Systems. IEEE, IEEE, New York, NY, USA, 1035--1040. https://doi.org/10.1109/ITSC.2015.172

Digital Library

[107]

Philipp Wintersberger, Dmitrijs Dmitrenko, Clemens Schartmüller, Anna-Katharina Frison, Emanuela Maggioni, Marianna Obrist, and Andreas Riener. 2019. S(C)ENTINEL: Monitoring Automated Vehicles with Olfactory Reliability Displays. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI '19). Association for Computing Machinery, New York, NY, USA, 538--546. https://doi.org/10.1145/3301275.3302332

Digital Library

[108]

Philipp Wintersberger, Anna-Katharina Frison, Andreas Riener, and Tamara von Sawitzky. 2019. Fostering User Acceptance and Trust in Fully Automated Vehicles: Evaluating the Potential of Augmented Reality. PRESENCE: Virtual and Augmented Reality 27, 1 (2019), 46--62. https://doi.org/10.1162/pres_a_00320 arXiv:https://doi.org/10.1162/pres_a_00320

Digital Library

[109]

Philipp Wintersberger, Hannah Nicklas, Thomas Martlbauer, Stephan Hammer, and Andreas Riener. 2020. Explainable Automation: Personalized and Adaptive UIs to Foster Trust and Understanding of Driving Automation Systems. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI '20). Association for Computing Machinery, New York, NY, USA, 252--261. https://doi.org/10.1145/3409120.3410659

Digital Library

[110]

Philipp Wintersberger, Tamara von Sawitzky, Anna-Katharina Frison, and Andreas Riener. 2017. Traffic Augmentation as a Means to Increase Trust in Automated Driving Systems. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter (Cagliari, Italy) (CHItaly '17). Association for Computing Machinery, New York, NY, USA, Article 17, 7 pages. https://doi.org/10.1145/3125571.3125600

Digital Library

[111]

Bo Yang, Tatsuya Obana, Zheng Wang, Tsutomu Kaizuka, Toshiyuki Sugimachi, Toshiaki Sakurai, Tetsuo Maki, and Kimihiko Nakano. 2020. Evaluations of Different Human Machine Interfaces for Presenting Right-Turn Timing at Intersections., 12 pages.

[112]

Changrak Yoon, Kyongho Kim, Hye Sun Park, Min Woo Park, and Soon Ki Jung. 2014. Development of augmented forward collision warning system for Head-Up Display. In 17th International IEEE Conference on Intelligent Transportation Systems (ITSC). IEEE, IEEE, New York, NY, USA, 2277--2279.

[113]

Changrak Yoon and Kyong-Ho Kim. 2015. Augmented reality information registration for head-up display. In 2015 International Conference on Information and Communication Technology Convergence (ICTC). IEEE, IEEE, New York, NY, USA, 1135--1137.

Cited By

Meinhardt LColley MTahmid MRädler MRukzio E(2024)Wind of Change: Investigating Information Visualizations for Passengers and Residents' Perception of Automated Urban Air MobilityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997538:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699753
Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Kim GHwang SSeong MYeo DRus DKim S(2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678544
Show More Cited By

Index Terms

How Should Automated Vehicles Communicate Critical Situations?: A Comparative Analysis of Visualization Concepts
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction devices
      1. Haptic devices

Recommendations

Effects of Semantic Segmentation Visualization on Trust, Situation Awareness, and Cognitive Load in Highly Automated Vehicles
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Autonomous vehicles could improve mobility, safety, and inclusion in traffic. While this technology seems within reach, its successful introduction depends on the intended user’s acceptance. A substantial factor for this acceptance is trust in the ...
Are automated vehicles safer than manually driven cars?
Abstract
Are automated vehicles really safer than manually driven vehicles? If so, how would we know? Answering this question has spurred a contentious debate. Unfortunately, several issues make answering this question difficult for the foreseeable future. ...
Dynamic intersections and self-driving vehicles
ICCPS '18: Proceedings of the 9th ACM/IEEE International Conference on Cyber-Physical Systems

Connected and automated vehicles are expected to be at the core of future intelligent transportation systems. One of the main practical challenges for self-driving vehicles on public roads is safe cooperation and collaboration among multiple vehicles ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 5, Issue 3

Sept 2021

1443 pages

EISSN:2474-9567

DOI:10.1145/3486621

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2021

Published in IMWUT Volume 5, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,007
Total Downloads

Downloads (Last 12 months)236
Downloads (Last 6 weeks)8

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Meinhardt LColley MTahmid MRädler MRukzio E(2024)Wind of Change: Investigating Information Visualizations for Passengers and Residents' Perception of Automated Urban Air MobilityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997538:4(1-31)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699753
Stampf ASasalovici MMeinhardt LColley MGiss MRukzio E(2024)Move, Connect, Interact: Introducing a Design Space for Cross-Traffic InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785808:3(1-40)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678580
Kim GHwang SSeong MYeo DRus DKim S(2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678544
Qiu ZMcGill MPöhlmann KBrewster S(2024)Augmenting Virtual Spatial UIs with Physics- and Direction-Based Visual Motion Cues to Non-Disruptively Mitigate Motion SicknessProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682079(1-10)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682079
Qiu ZMcGill MPöhlmann KBrewster S(2024)Acceleration instead of Speed: Acceleration Visual Cues in VR for Reduced Motion Sickness in Linear MotionAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685023(56-61)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685023
Wang MJeon M(2024)I Don't Know What Happens, But… Do I Really Need that Explanation?Adjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3680517(310-311)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3680517
Asha AColley MSultana SSharlin E(2024)Introducing AV-Sketch: An Immersive Participatory Design Tool for Automated Vehicle — Passenger InteractionProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675705(83-93)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3640792.3675705
Colley MSpeidel OStrohbeck JRixen JBelz JRukzio E(2024)Effects of Uncertain Trajectory Prediction Visualization in Highly Automated Vehicles on Trust, Situation Awareness, and Cognitive LoadProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314087:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631408
Ding YJia LDu N(2024)One Size Does Not Fit All: Designing and Evaluating Criticality-Adaptive Displays in Highly Automated VehiclesProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642648(1-15)Online publication date: 11-May-2024
https://doi.org/10.1145/3613904.3642648
Colley MRajabi ORukzio E(2024)Investigating the Effects of External Communication and Platoon Behavior on Manual Drivers at Highway AccessProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642365(1-15)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642365
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents