Abstract
Gestural inputs are nowadays widely applied to in-car interactive systems. The emerging sensing technologies allow for micro-gestures that can be achieved with less energy and are performed probably when the driver is grasping the steering wheel, thereby reducing the user attention to human–vehicle interaction. The movability of hands and fingers has to be considered before designing micro-gestures for driving scenarios, thus the newly defined gestures may be utterly different to the familiar multi-touch or body gestures. This paper presents a set of micro-gestures which are designed for intuitively commanding the in-car information system by taking both the gesture meanings and physical limitations into account. The study sets out the results of evaluating the feasibility of gesture sets with its performance in dual-task situation. The learnability and intuitiveness of micro-gestures as well as the effects they have on driving tasks are evaluated, and the effects of different grasping postures on the performance of novice drivers are also compared. It is concluded that the micro-gestures particularly designed for the grasp interface have advantages in multi-tasking, and they are appreciated by users who participated in the evaluation test.
Similar content being viewed by others
Notes
If no reaction was detected in the time interval between two stimuli, the first stimulus was a missed signal (false negative). The wrong reactions (false positive) occurred on two situations. First, more than one reactions was detected in the time interval between two stimuli, in this case the reactions that were made later than the first one were regarded as mistakes. Second, if only one reaction was detected, and the fixation did not overlap or get close to the signal on the screen, experimenters judged it to be an unintentional response.
References
Alpern, M., Minardo, K.: (2003). Developing a car gesture interface for use as a secondary task. In: CHI EA’03, Florida, USA, pp 932–933
Angelini, L., Caon, M., Carrino, F., Carrino, S., Lalanne, D., Khaled, O.A., Mugellini, E.: WheelSense: Enabling Tangible Gestures on the Steering Wheel for In-Car Natural Interaction, 8005, pp. 531–540. Springer, Berlin Heidelberg (2013)
Angelini, L., Carrino, F., Carrino, S., et al.: (2014). Gesturing on the steering wheel: a user-elicited taxonomy. In: Proceedings of AutomotiveUI’14, pp. 1–8, Seattle, WA, USA
Angelini, L., Baumgartner, J., Carrino, F., et al.: (2016). Comparing gesture, speech and touch interaction modalities for in-vehicle infotainment system. In: IHM’16, Fribourg, Switzerland
Ashbrook, D.: (2007). Supporting mobile microinteractions. Georgia Institute of Technology. Dissertation
Bach, K.M., Jæger, M.G., Skov, M.S., Thomassen, N.G.: (2008). You can touch, but you can’t look: Interacting with in-vehicle systems. In: Proceedings of CHI’ 08, pp. 1139–1148, Florence, Italy
Chan, E., Seyed, T., Stuerzlinger, W., Yang, X.D., Maurer, F.: (2016). User elicitation on single-hand microgestures. In: Proceedings of CHI’16, pp. 3403–3414, San Jose, CA, USA
Döring, T., Kern, D., Marshall, P., et al.: (2011). Gestural interaction on the steering wheel: reducing the visual demand. In: Proc.CHI’11, pp. 483–492, Vancouver, Canada
Endres, C., Dimitrov., S.: (2010). Using a Theremin for micro-gesture recognition in an automotive environment. In: Proceedings of AutomotiveUI’10, Pittsburgh, Pennsylvania
Geiser, G.: (1985). Man machine interaction in vehicles. ATZ, 87, pp. 74–77
González, I.E., Wobbrock, J.O., Chau, D.H., Faulring, A., Myers, B.A.: (2007). Eyes on the road, hands on the wheel: thumb-based interaction techniques for input on steering wheels. In: Graphics interface conference 2007, pp. 95–102, Montréal, Canada
Gupta, S., Molchanov, P., Yang, X., Kim, K., Tyree, S., Kautz, J.: (2016). Towards selecting robust hand gestures for automotive interfaces. In: Intelligent vehicles symposium, IEEE, pp. 1350–1357
Häuslschmid, R., Menrad, B., Butz, A.: (2015). Freehand vs. micro gestures in the car: driving performance and user experience. In: 3D user interfaces, 2015 IEEE symposium, pp. 159–160, France
Horst, A.R.A., van der Martens, M.H.: The peripheral detection task (PDT): on-line measurement of driver cognitive workload and selective attention. SAE Int. 634(4), 73–89 (2010)
Hoven, V.D.E., Mazalek, A.: Grasping gestures: gesturing with physical artifacts. Artif. Intell. Eng. Des. Anal. Manuf. 25, 255–271 (2011)
Koyama, S., Sugiura, Y., Ogata, M., Withana, A., Uema, Y., Honda, M.: (2014). Multi-touch steering wheel for in-car tertiary applications using infrared sensors. In: Proceedings of AH’14, pp. 1–4, Kobe, Japan
Lee, S.H., Yoon, S.O., Shin, J.H.: (2015). On-wheel finger gesture control for in-vehicle systems on central consoles. In: Proceedings of Automotiveui’15, pp. 94–99, Nottingham, United Kingdom
Loclair, C., Gustafson, S., Baudisch, P.: (2010). PinchWatch: A wearable device for one-handed microinteractions. In: Proceedings of MobileHCI 2010, Lisbon, Portugal
Loehmann, S., Knobel, M., Lamara, M., Butz, A.: (2013). Culturally independent gestures for in-car interactions. In: Kotzé, P., et al. (eds.): INTERACT 2013, Part III, LNCS 8119, pp. 538–545
Ma, T., Wee, W., Han, C.Y., Zhou, X.: (2011). A method for single hand fist gesture input to enhance human computer interaction. In: Proceedings of HCI’13, pp. 291–300, Las Vegas, USA
Mahr, A., Endres, C., Schneeberger, T., Müller, C.: (2011). Determining human-centered parameters of ergonomic micro-gesture interaction for drivers using the theater approach. In: Proceedings of AutomotiveUI’11, pp. 151–158, Salzburg, Austria
Matthies, D.J.C., Lecolinet, E., Perrault, S.T., Zhao, S.: (2014). Peripheral microinteraction for wearable computing. In: Workshop on peripheral interaction: shaping the research and design space at CHI 2014
Müller, C., Weinburg, G.: Multimodal input in the car, today and tomorrow. IEEE Multimed. 18(1), 98–103 (2011)
Murata, Y., Yoshida, K., Suzuki, K., Takahashi, D.: (2013). Proposal of an automobile driving interface using gesture operation for disabled people. ACHI, pp. 472–478
Neßelrath, R., Moniri, M.M., Feld, M.: (2016). Combining speech, gaze, and micro-gestures for the multimodal control of in-car functions. In: 12th International Conference on Intelligent Environment, pp. 190–193, London, UK
Nielson, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. Lect. Notes Comput. Sci. 17(17), 1445–1453 (2003)
Oh, B.H., Hong, K.S.: Finger gesture-based three dimension mobile user interaction using a rear-facing camera. Int. J. Multimed. Ubiquitous Eng. 8(5), 119–130 (2013)
Penn, F.: (2015). Micro-gesture interaction on the gear shift. Universität Passau, Dissertation
Pfleging, B., Schneegass, S., Schmidt, A.: (2012). Multimodal interaction in the car: Combining speech and gestures on the steering wheel. In: Proceedings of AutomotiveUI’12, Portsmouth, NH, USA
Riener, A., Ferscha, A., Bachmair, F., Hagmüller, P., Lemme, A., Muttenthaler, D.: (2013). Standardization of the in-car gesture interaction space. Proceedings of AutomotiveUI’13, pp. 155–162, Eindhoven, Netherlands
Stecher, M., Baseler, E., Draxler, L., Fricke, L., Michel, B., Zimmermann, A., Bengler, K.: (2015). Tracking down the intuitiveness of gesture interaction in the truck domain. In: 6th International conference on applied human factors and ergonomics (AHFE 2015) and the affiliated conferences, Vol. 3, pp. 3176–3183
Tan, Y., Yoon, S.H., Ramani, K.: (2017). BikeGesture: user elicitation and performance of micro hand gesture input for cycling. In: CHI EA’17, pp. 2147–2154, Denver, CO, USA
Wagner, J., Lecolinet, E., Selker, T.: (2014). Multi-finger chords for hand-held tablets: recognizable and memorable. In: Proceedings of CHI’14, pp. 2883–2892, Toronto, ON, Canada
Wobbrock, J.O., Morris, M.R., Wilson, A.D.: (2009). User-defined gestures for surface computing. In: Proceedings of CHI’09, pp. 1083–1092
Wolf, K., Naumann, A., Rohs, M., Müller, J.: (2011). A taxonomy of microinteractions: defining microgestures based on ergonomic and scenario-dependent requirements. In: Campos, P., et al. (eds.), INTERACT 2011, Part I, LNCS 6946, pp. 559–575
Wolf, K., Schleicher, R., Kratz, S., Rohs, M.: (2013). Tickle: a surface-independent interaction technique for grasp interfaces. In: Proceedings of TEI’13, pp. 185–192, Barcelona, Spain
Wolf, K.: Microgestures—enabling gesture input with busy hands. In: Bakker, S., et al. (eds.) Peripheral Interaction, pp. 95–116. Springer, Switzerland (2016)
Zaiti, I.A., Pentiuc, S., G. and Vatavu, R.D.: On free-hand TV control: experimental results on user-elicited gestures with leap motion. Pers. Ubiquitous Comput. 19, 821–838 (2015)
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
The study protocol conforms to the ethnical standard of the institutional committee and to the declaration of ethical principles adopted by the 18th WMA General Assembly, Helsinki, Finland, June 1964 and its later amendments. The Queen Mary Ethics of Research Committee approved the study protocol which includes all procedures performed in this study with the following reference number QMREC1749a.
Informed consent
Informed consent was obtained from all individual participants involved in the study. This paper does not include any studies with animals conducted by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Xiao, Y., He, R. The intuitive grasp interface: design and evaluation of micro-gestures on the steering wheel for driving scenario. Univ Access Inf Soc 19, 433–450 (2020). https://doi.org/10.1007/s10209-019-00647-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-019-00647-0