More Web Proxy on the site http://driver.im/

research-article

Using eye tracking for evaluating web search interfaces

Authors:

Hilal Al Maqbali,

Mingfang WuAuthors Info & Claims

ADCS '13: Proceedings of the 18th Australasian Document Computing Symposium

Pages 2 - 9

https://doi.org/10.1145/2537734.2537747

Published: 05 December 2013 Publication History

Abstract

Using eye tracking in the evaluation of web search interfaces can provide rich information on users' information search behaviour, particularly in the matter of user interaction with different informative components on a search results screen. One of the main issues affecting the use of eye tracking in research is the quality of captured eye movements (calibration), therefore, in this paper, we propose a method that allows us to determine the quality of calibration, since the existing eye tracking system (Tobii Studio) does not provide any criteria for this aspect. Another issue addressed in this paper is the adaptation of gaze direction. We use a black screen displaying for 3 seconds between screens to avoid the effect of the previous screen on user gaze direction on the coming screen. A further issue when employing eye tracking in the evaluation of web search interfaces is the selection of the appropriate filter for the raw gaze-points data. In our studies, we filtered this data by removing noise, identifying gaze points that occur in Area of Interests (AOIs), optimising gaze data and identifying viewed AOIs.

References

[1]

R. A. Abrams, D. E. Meyer and S. Kornblum. Speed and accuracy of saccadic eye movements: Characteristics of impulse variability in the oculomotor system. Journal of Experimental Psychology: Human Perception and Performance, Volume 15, Number 3, pages 529--543, 1989.

[2]

H. Ali {Al Maqbali}, F. Scholer, J. A. Thom and M. Wu. User interaction with novel web search interfaces. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7, pages 301--304. ACM, 2009.

Digital Library

[3]

C. S. Campbell and P. P. Maglio. A robust algorithm for reading detection. In Proceedings of the 2001 workshop on Perceptive user interfaces, pages 1--7. ACM, 2001.

Digital Library

[4]

M. S. Castelhano and J. M. Henderson. The influence of color on the perception of scene gist. Journal of Experimental Psychology: Human Perception and Performance, Volume 34, Number 3, pages 660, 2008.

[5]

A. Chapanis. Theory and methods for analyzing errors in man-machine systems. Annals of the New York Academy of Sciences, Volume 51, Number 7, pages 1179--1203, 1951.

[6]

M. J. Cole, J. Gwizdka, C. Liu and N. J. Belkin. Dynamic assessment of information acquisition effort during interactive search. Proceedings of the American Society for Information Science and Technology, Volume 48, Number 1, pages 1--10, 2011.

[7]

H. Drewes. Eye gaze tracking for human computer interaction. Ph.D. thesis, Ludwig-Maximilians-Universität München, 2010.

[8]

A. Duchowski. Eye tracking methodology: Theory and practice, Volume 373. Springer, 2007.

Digital Library

[9]

A. Friedman and L. S. Liebelt. On the time course of viewing pictures with a view towards remembering. Eye movements: Cognition and visual perception, pages 137--155, 1981.

[10]

J. H. Goldberg and J. I. Helfman. Scanpath clustering and aggregation. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 227--234. ACM, 2010.

Digital Library

[11]

J. H. Goldberg and X. P. Kotval. Computer interface evaluation using eye movements: methods and constructs. International Journal of Industrial Ergonomics, Volume 24, Number 6, pages 631--645, 1999.

[12]

R. N. Haber and M. Hershenson. The psychology of visual perception. Holt, Rinehart & Winston, 1973.

[13]

K. Holmqvist, M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka and J. Van de Weijer. Eye tracking: A comprehensive guide to methods and measures. Oxford University Press, UK, England, 2011.

[14]

A. J. Hornof and T. Halverson. Cleaning up systematic error in eye-tracking data by using required fixation locations. Behavior Research Methods, Volume 34, Number 4, pages 592--604, 2002.

[15]

J. Hyönä, R. F. Lorch Jr and J. K. Kaakinen. Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology, Volume 94, Number 1, pages 44, 2002.

[16]

A. W. Inhoff and K. Rayner. Parafoveal word processing during eye fixations in reading: Effects of word frequency. Attention, Perception, & Psychophysics, Volume 40, Number 6, pages 431--439, 1986.

[17]

R. J. K. Jacob and K. S. Karn. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. The Mind's Eye: Cognitive and Applied Aspects of Eye Movement Research, pages 573--603, 2003.

[18]

R. Jenkins, J. D. Beaver and A. J. Calder. I thought you were looking at me direction-specific aftereffects in gaze perception. Psychological Science, Volume 17, Number 6, pages 506--513, 2006.

[19]

R. Karsh and FW Breitenbach. Looking at looking: The amorphous fixation measure. Eye movements and psychological functions: International views, pages 53--64, 1983.

[20]

D. Kelly and C. Cool. The effects of topic familiarity on information search behavior. In Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, pages 74--75. ACM, 2002.

Digital Library

[21]

E. Kowler. Eye movements and their role in visual and cognitive processes, Volume 4. Elsevier Science Ltd, 1990.

[22]

Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Do users find looking at text more useful than visual representations? a comparison of three search result interfaces. In Proceedings of the Australasian Document Computing Symposium, pages 35--42, 2009.

[23]

Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Evaluating the effectiveness of visual summaries for web search. The Fifteen Australasian Document Computing Symposium (ADCS2010), Melbourne, Australia, pages 36--43, 2010.

[24]

Hilal Al Maqbali, Falk Scholer, James A. Thom and Mingfang Wu. Tracking the impact of visual summaries on navigational web search. Manuscript submitted for publication to JASIST (Under revision to address reviewers' comments), 2012.

[25]

A. Palanica and R. J. Itier. Searching for a perceived gaze direction using eye tracking. Journal of Vision, Volume 11, Number 2, 2011.

[26]

A. Pollatsek, K. Rayner and J. M. Henderson. Role of spatial location in integration of pictorial information across saccades. Journal of Experimental Psychology: Human Perception and Performance, Volume 16, Number 1, pages 199--210, 1990.

[27]

K. Rayner, S. P. Liversedge, S. J. White and D. Vergilino-Perez. Reading disappearing text cognitive control of eye movements. Psychological science, Volume 14, Number 4, pages 385--388, 2003.

[28]

E. D. Reichle, K. Rayner and A. Pollatsek. The E-Z reader model of eye-movement control in reading: Comparisons to other models. Behavioral and brain sciences, Volume 26, Number 4, pages 445--476, 2003.

[29]

Erik D. Reichle, Alexander Pollatsek, Donald L. Fisher and Keith Rayner. Toward a model of eye movement control in reading. Psychological review, Volume 105, Number 1, pages 125--157, 1998.

[30]

Rayner Reichle. Comparing the e-z reader model to other models of eye movement control in reading, 2000.

[31]

D. D. Salvucci and J. H. Goldberg. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 symposium on Eye tracking research & applications, pages 71--78. ACM, 2000.

Digital Library

[32]

D. Sauter, BJ Martin, N. Di Renzo and C. Vomscheid. Analysis of eye tracking movements using innovations generated by a kalman filter. Medical and biological Engineering and Computing, Volume 29, Number 1, pages 63--69, 1991.

[33]

J. B. J. Smeets and I. T. C. Hooge. Nature of variability in saccades. Journal of neurophysiology, Volume 90, Number 1, pages 12--20, 2003.

[34]

R. Williams and R. Morris. Eye movements, word familiarity, and vocabulary acquisition. European Journal of Cognitive Psychology, Volume 16, Number 1--2, pages 312--339, 2004.

Cited By

Fan YWang WXin YLv MWang L(2014)Eye-Tracking Analysis for the Disabled in the Spatial EnvironmentProceedings of the 14th International Conference on Man-Machine-Environment System Engineering10.1007/978-3-662-44067-4_9(75-81)Online publication date: 9-Aug-2014
https://doi.org/10.1007/978-3-662-44067-4_9

Using eye tracking for evaluating web search interfaces
1. Human-centered computing

Recommendations

Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
Abstract
Spontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Eye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...
4th international workshop on pervasive eye tracking and mobile eye-based interaction
UbiComp '14 Adjunct: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication

Previous work on eye tracking and eye-based human-computer interfaces mainly concentrated on making use of the eyes in traditional desktop settings. With the recent growth of interest in smart glass devices and low-cost eye trackers, however, gaze-based ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ADCS '13: Proceedings of the 18th Australasian Document Computing Symposium

December 2013

126 pages

ISBN:9781450325240

DOI:10.1145/2537734

Conference Chairs:
Shane Culpepper
RMIT University
,
Guido Zuccon
CSIRO
,
General Chair:
Laurianne Sitbon
Queensland University of Technology

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 December 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ADCS '13

ADCS '13: The Australasian Document Computing Symposium

December 5 - 6, 2013

Queensland, Brisbane, Australia

Acceptance Rates

ADCS '13 Paper Acceptance Rate 12 of 23 submissions, 52%;

Overall Acceptance Rate 30 of 57 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
311
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fan YWang WXin YLv MWang L(2014)Eye-Tracking Analysis for the Disabled in the Spatial EnvironmentProceedings of the 14th International Conference on Man-Machine-Environment System Engineering10.1007/978-3-662-44067-4_9(75-81)Online publication date: 9-Aug-2014
https://doi.org/10.1007/978-3-662-44067-4_9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten