More Web Proxy on the site http://driver.im/

research-article

Entropy of eye movements while reading code or text

Authors:

Krzysztof Krejtz,

Andrew T. Duchowski,

Katarzyna Wisiecka,

Izabela KrejtzAuthors Info & Claims

EMIP '22: Proceedings of the Tenth International Workshop on Eye Movements in Programming

Pages 8 - 14

https://doi.org/10.1145/3524488.3527365

Published: 28 November 2022 Publication History

Abstract

A new gaze-based analysis method is presented based on word span entropy, suitable for comparison of eye movements collected during reading of code or text. Word span entropy is derived from gaze transition entropy but differs in that the transition matrix represents word span instead of gaze transition between Areas Of Interest (AOIs). Empirical evidence shows that, as expected, an increase in word span entropy is related to a shorter response time, especially when reading code, showcasing the metric's analytical utility.

References

[1]

Naser Al Madi, Cole S. Peterson, Bonita Sharif, and Jonathan I. Maletic. 2021. From Novice to Expert: Analysis of Token Level Effects in a Longitudinal Eye Tracking Study. In 2021 IEEE/ACM 29th International Conference on Program Comprehension (ICPC). 172--183.

[2]

Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting Linear Mixed-Effects Models Using lme4. Journal of Statistical Software 67, 1 (2015), 1--48.

[3]

André Beauducel and M Kersting. 2002. Fluid and cristallized intelligence and the Berlin Model of Intelligence Structure (BIS). European Journal of Psychological Assessment 18 (01 2002), 97--112.

[4]

Teresa Busjahn, Roman Bednarik, Andrew Begel, Martha Crosby, James H. Paterson, Carsten Schulte, Bonita Sharif, and Sascha Tamm. 2015. Eye Movements in Code Reading: Relaxing the Linear Order. In 2015 IEEE 23rd International Conference on Program Comprehension. 255--265.

Digital Library

[5]

Teresa Busjahn and Sascha Tamm. 2021. A Deeper Analysis of AOI Coverage in Code Reading. In ACM Symposium on Eye Tracking Research and Applications. ACM, Virtual Event Germany, 1--7.

Digital Library

[6]

Martha E. Crosby and Jan Stelovsky. 1990. How do we read algorithms? A case study. Computer 23, 1 (1990), 25--35.

Digital Library

[7]

Andrew T. Duchowski. 2017. Eye Tracking Methodology: Theory & Practice (3rd ed.). Springer-Verlag, Inc., London, UK.

[8]

Andrew T. Duchowski, Sophie Jörg, Jaret Screws, Nina A. Gehrer, Michael Schönenberg, and Krzysztof Krejtz. 2019. Guiding Gaze: Expressive Models of Reading and Face Scanning. In Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications (Denver, CO) (ETRA '19). Association for Computing Machinery, New York, NY, Article 25, 9 pages.

Digital Library

[9]

Islam Akef Ebeid and Jacek Gwizdka. 2018. Real-time gaze transition entropy. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications. ACM, Warsaw Poland, 1--3.

Digital Library

[10]

Dror G. Feitelson. 2019. Eye Tracking and Program Comprehension. In 2019 IEEE/ACM 6th International Workshop on Eye Movements in Programming (EMIP). 1--1.

Digital Library

[11]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183.

[12]

Elizabeth Hume and Frédéric Mailhot. 2013. The Role of Entropy and Surprisal in Phonologization and Language Change. In Origins of Sound Change: Approaches to Phonologization, Alan C. L. Yu (Ed.). Oxford University Press, Oxford, UK, 29--47.

[13]

Ahmad Jbara and Dror G. Feitelson. 2015. How Programmers Read Regular Code: A Controlled Experiment Using Eye Tracking. In 2015 IEEE 23rd International Conference on Program Comprehension. 244--254.

Digital Library

[14]

Philip Nicholas Johnson-Laird. 1983. Mental models: Towards a cognitive science of language, inference, and consciousness. Number 6. Harvard University Press.

[15]

Krzysztof Krejtz, Andrew Duchowski, Izabela Krejtz, Agnieszka Szarkowska, and Agata Kopacz. 2016b. Discerning Ambient/Focal Attention with Coefficient K. ACM Transactions on Applied Perception 13, 3, Article 11 (may 2016), 20 pages.

Digital Library

[16]

Krzysztof Krejtz, Andrew Duchowski, Tomasz Szmidt, Izabela Krejtz, Fernando González Perilli, Ana Pires, Anna Vilaro, and Natalia Villalobos. 2015. Gaze Transition Entropy. ACM Transactions on Applied Perception 13, 1, Article 4 (Dec. 2015), 20 pages.

Digital Library

[17]

Krzysztof Krejtz, Andrew T. Duchowski, Izabela Krejtz, Agata Kopacz, and Piotr Chrzăstowski-Wachtel. 2016a. Gaze transitions when learning with multimedia. Journal of Eye Movement Research 9, 1 (2016).

[18]

Krzysztof Krejtz, Tomasz Szmidt, Andrew T. Duchowski, and Izabela Krejtz. 2014. Entropy-Based Statistical Analysis of Eye Movement Transitions. In Proceedings of the Symposium on Eye Tracking Research and Applications (Safety Harbor, Florida) (ETRA '14). Association for Computing Machinery, New York, NY, USA, 159--166.

Digital Library

[19]

Alexandra Kuznetsova, Per B. Brockhoff, and Rune H. B. Christensen. 2017. lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82, 13 (2017), 1--26.

[20]

Ian McChesney and Raymond Bond. 2019. Eye tracking analysis of computer program comprehension in programmers with dyslexia. Empirical Software Engineering 24, 3 (June 2019), 1109--1154.

Digital Library

[21]

Jonathan Peirce, Jeremy R. Gray, Sol Simpson, Michael MacAskill, Richard Höchen-berger, Hiroyuki Sogo, Erik Kastman, and Jonas Kristoffer Lindeløv. 2019. PsychoPy2: Experiments in behavior made easy. Behavior Research Methods 51, 1 (2019), 195--203.

[22]

R Core Team. 2021. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/

[23]

Keith Rayner. 1998. Eye Movements in Reading and Information Processing: 20 Years of Research. Psychological Bulletin 124, 3 (1998), 372--422.

[24]

Zohreh Sharafi, Timothy Shaffer, Bonita Sharif, and Yann-Gaël Guéhénéuc. 2015. Eye-Tracking Metrics in Software Engineering. In 2015 Asia-Pacific Software Engineering Conference (APSEC). 96--103.

[25]

Robert Thibadeau, Marcel Adam Just, and Patricia A. Carpenter. 1982. A Model of the Time Course and Content of Reading. Cognitive Science 6 (1982), 157--203.

Cited By

Stark PJung AHahn JKasneci EGöllner R(2024)Using Gaze Transition Entropy to Detect Classroom Discourse in a Virtual Reality ClassroomProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653335(1-11)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653335
Zajenkowska ABodecka-Zych MDuda EGagnon JKrejtz K(2024)“The way I see it makes me believe you intentionally did it”: Intentionality ascription and gaze transition entropy in violent offendersBiological Psychology10.1016/j.biopsycho.2024.108962(108962)Online publication date: Dec-2024
https://doi.org/10.1016/j.biopsycho.2024.108962
Grabinger LHauser FWolff CMottok J(2024)On Eye Tracking in Software EngineeringSN Computer Science10.1007/s42979-024-03045-35:6Online publication date: 26-Jul-2024
https://dl.acm.org/doi/10.1007/s42979-024-03045-3
Show More Cited By

Index Terms

Entropy of eye movements while reading code or text
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software organization and properties

Recommendations

Eye Movements in Code Reading: Relaxing the Linear Order
ICPC '15: Proceedings of the 2015 IEEE 23rd International Conference on Program Comprehension

Code reading is an important skill in programming. Inspired by the linearity that people exhibit while natural language text reading, we designed local and global gaze-based measures to characterize linearity (left-to-right and top-to-bottom) in reading ...
Analysing EOG signal features for the discrimination of eye movements with wearable devices
PETMEI '11: Proceedings of the 1st international workshop on pervasive eye tracking & mobile eye-based interaction

Eye tracking research in human-computer interaction and experimental psychology traditionally focuses on stationary devices and a small number of common eye movements. The advent of pervasive eye tracking promises new applications, such as eye-based ...
Can the E-Z Reader Model Predict Eye Movements Over Code? Towards a Model of Eye Movements Over Source Code
ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and Applications

Studies of eye movements during source code reading have supported the idea that reading source code differs fundamentally from reading natural text. The paper analyzed an existing data set of natural language and source code eye movement data using the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EMIP '22: Proceedings of the Tenth International Workshop on Eye Movements in Programming

May 2022

30 pages

ISBN:9781450392891

DOI:10.1145/3524488

Conference Chairs:
Naser Al Madi
Colby College
,
Bonita Sharif
University of Nebraska - Lincoln

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

In-Cooperation

IEEE CS

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '22

Sponsor:

SIGSOFT

ICSE '22: 44th International Conference on Software Engineering

May 18, 2022

Pennsylvania, Pittsburgh

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
124
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)3

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Stark PJung AHahn JKasneci EGöllner R(2024)Using Gaze Transition Entropy to Detect Classroom Discourse in a Virtual Reality ClassroomProceedings of the 2024 Symposium on Eye Tracking Research and Applications10.1145/3649902.3653335(1-11)Online publication date: 4-Jun-2024
https://dl.acm.org/doi/10.1145/3649902.3653335
Zajenkowska ABodecka-Zych MDuda EGagnon JKrejtz K(2024)“The way I see it makes me believe you intentionally did it”: Intentionality ascription and gaze transition entropy in violent offendersBiological Psychology10.1016/j.biopsycho.2024.108962(108962)Online publication date: Dec-2024
https://doi.org/10.1016/j.biopsycho.2024.108962
Grabinger LHauser FWolff CMottok J(2024)On Eye Tracking in Software EngineeringSN Computer Science10.1007/s42979-024-03045-35:6Online publication date: 26-Jul-2024
https://dl.acm.org/doi/10.1007/s42979-024-03045-3
Krejtz KSzczecinski PPawlowska ARutkowska-Siuda DWisiecka KMilczarski PHlobaz ADuchowski AKrejtz I(2023)A Unified Look at Cultural Heritage: Comparison of Aggregated Scanpaths over Architectural ArtifactsProceedings of the ACM on Human-Computer Interaction10.1145/35911387:ETRA(1-17)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3591138
Al Madi NBusjahn TSharif B(2023)Summary of the Tenth International Workshop on EyeMovements in Programming (EMIP 2022)ACM SIGSOFT Software Engineering Notes10.1145/3573074.357309448:1(79-80)Online publication date: 17-Jan-2023
https://dl.acm.org/doi/10.1145/3573074.3573094

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents