Abstract
Acquisition and consumption of visual media such as digital image and videos is becoming one of the most important forms of modern communication. However, since the creation and sharing of images is increasing exponentially, images as a media form suffer from being devalued, as the quality of single images are getting less and less important, and the frequency of the shared content turns to be the focus. In this work, an interactive system which allows users to interact with volatile and diverting artwork based on their eye movement only is presented. The system uses real-time image-abstraction techniques to create an artwork unique to each situation. It supports multiple, distinct interaction modes, which share common design principles, enabling users to experience game-like interactions focusing on eye-movement and the diverting image content itself. This approach hints at possible future research in the field of relaxation exercises and casual art consumption and creation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alonso, R., Causse, M., Vachon, F., Parise, R., Dehais, F., Terrier, P.: Evaluation of head-free eye tracking as an input device for air traffic control. Ergonomics 56, 246–255 (2013). https://doi.org/10.1080/00140139.2012.744473
Anapur, E., Fink, G.: Drawing with his eyes - graham fink in an interview (2017). https://www.widewalls.ch/magazine/interview-graham-fink
Blascheck, T., Kurzhals, K., Raschke, M., Burch, M., Weiskopf, D., Ertl, T.: State-of-the-art of visualization for eye tracking data. In: EuroVis (2014)
DiVerdi, S., Krishnaswamy, A., Mech, R., Ito, D.: Painting with polygons: a procedural watercolor engine. IEEE Trans. Vis. Comput. Graph. 19, 723–735 (2013)
Dürschmid, T., Söchting, M., Semmo, A., Trapp, M., Döllner, J.: ProsumerFX: mobile design of image stylization components. In: SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications, SA 2017, pp. 1:1–1:8. ACM, New York (2017). https://doi.org/10.1145/3132787.3139208. http://doi.acm.org/10.1145/3132787.3139208
Fink, G.: Drawing with my eyes (2015). https://grahamfink.com/eye-drawings
Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley Longman Publishing Co., Inc., Boston (1995)
Isenberg, T.: Interactive NPAR: What type of tools should we create? In: Proceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering, Expresive 2016, pp. 89–96. Eurographics Association, Aire-la-Ville (2016). http://dl.acm.org/citation.cfm?id=2981324.2981337
Kasprowski, P., Harezlak, K., Niezabitowski, M.: Eye movement tracking as a new promising modality for human computer interaction. In: 2016 17th International Carpathian Control Conference (ICCC), pp. 314–318, May 2016. https://doi.org/10.1109/CarpathianCC.2016.7501115
Kiefer, P., Giannopoulos, I., Raubal, M., Duchowski, A.: Eye tracking for spatial research: cognition, computation, challenges. Spat. Cogn. Comput. 17(1–2), 1–19 (2017). https://doi.org/10.1080/13875868.2016.1254634
Kiili, K., Ketamo, H., Kickmeier-Rust, M.: Evaluating the usefulness of eye tracking in game-based learning. Int. J. Serious Games 1(2) (2014). https://doi.org/10.17083/ijsg.v1i2.15. http://journal.seriousgamessociety.org/index.php/IJSG/article/view/15
Kyprianidis, J.E., Collomosse, J., Wang, T., Isenberg, T.: State of the ‘art’: a taxonomy of artistic stylization techniques for images and video. IEEE Trans. Vis. Comput. Graph. 19(5), 866–885 (2013). https://doi.org/10.1109/TVCG.2012.160
Majaranta, P., Bulling, A.: Eye tracking and eye-based human–computer interaction. In: Fairclough, S.H., Gilleade, K. (eds.) Advances in Physiological Computing. HIS, pp. 39–65. Springer, London (2014). https://doi.org/10.1007/978-1-4471-6392-3_3
Mikami, S.: Molecular informatics. morphogenic substance via eye tracking (1996). https://bit.ly/2oezCZv
Mishra, U.: Inventions on GUI for eye cursor controls systems. CoRR abs/1404.6765 (2014). http://arxiv.org/abs/1404.6765
Quian Quiroga, R., Pedreira, C.: How do we see art: an eye-tracker study. Front. Hum. Neurosci. 5, 98 (2011). https://doi.org/10.3389/fnhum.2011.00098
Schwarz, M., Isenberg, T., Mason, K., Carpendale, S.: Modeling with rendering primitives: an interactive non-photorealistic canvas. In: Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, NPAR 2007, pp. 15–22. ACM, New York (2007). https://doi.org/10.1145/1274871.1274874. http://doi.acm.org/10.1145/1274871.1274874
Semmo, A., Dürschmid, T., Trapp, M., Klingbeil, M., Döllner, J., Pasewaldt, S.: Interactive image filtering with multiple levels-of-control on mobile devices. In: Proceedings SIGGRAPH ASIA Mobile Graphics and Interactive Applications (MGIA), pp. 2:1–2:8. ACM, New York (2016). https://doi.org/10.1145/2999508.2999521
Söchting, M., Trapp, M.: Controlling image-stylization techniques using eye tracking. In: Chessa, M., Paljic, A., Braz, J. (eds.) Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020, Volume 2: HUCAPP, Valletta, Malta, 27–29 February 2020, pp. 25–34. SCITEPRESS (2020). https://doi.org/10.5220/0008964500250034
Vandoren, P., Van Laerhoven, T., Claesen, L., Taelman, J., Raymaekers, C., Van Reeth, F.: IntuPaint: bridging the gap between physical and digital painting. In: 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems, pp. 65–72, October 2008. https://doi.org/10.1109/TABLETOP.2008.4660185
Vaughan, K., Armstrong, M.S., Gold, R., O’Connor, N., Jenneke, W., Tarrier, N.: A trial of eye movement desensitization compared to image habituation training and applied muscle relaxation in post-traumatic stress disorder. J. Behav. Ther. Exp. Psychiatry 25(4), 283–291 (1994). https://doi.org/10.1016/0005-7916(94)90036-1. http://www.sciencedirect.com/science/article/pii/0005791694900361
Zhai, S., Morimoto, C., Ihde, S.: Manual and gaze input cascaded (magic) pointing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1999, pp. 246–253. ACM, New York (1999). https://doi.org/10.1145/302979.303053. http://doi.acm.org/10.1145/302979.303053
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Söchting, M., Trapp, M. (2022). Tracking Eye Movement for Controlling Real-Time Image-Abstraction Techniques. In: Bouatouch, K., et al. Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2020. Communications in Computer and Information Science, vol 1474. Springer, Cham. https://doi.org/10.1007/978-3-030-94893-1_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-94893-1_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-94892-4
Online ISBN: 978-3-030-94893-1
eBook Packages: Computer ScienceComputer Science (R0)