A user study of web search session behaviour using eye tracking data
Pages 262 - 267
Abstract
In this paper we present and empirically evaluate a user study using a web search log and eye tracking to measure user behaviour during a query session, that is, a sequence of user queries, results page views and content page views, in order to find a specific piece of information. We evaluate different tasks, in terms of those who found the correct information, and in terms of the query session sequence itself, ordered by SERP (Search Engine Result Page), number and return visits to the results page for the same query. From this we are able to identify a number of different behaviour patterns for successful and unsuccessful users, and different trends in user activity during the query session. We find that a user behaves differently after the first query formulation, when we compare with the second formulation (both queries being for the same information item). The results can be used to improve the user experience in the query session, by recognising when the user is displaying one of the patterns we have found to have a low success rate, and offering contextual help at that point. The results may also contribute to improving the design of the results page.
References
[1]
Baeza-Yates, R., Hurtado, C., Mendoza, M. and Dupret G., (2005). Modeling user search behavior. In Proc.3rd Latin American Web Congress, 31 Oct.-2 Nov, Buenos Aires, Argentina, p. 242--251, IEEE Washington DC, USA.
[2]
Buscher, G., Dumais, S., and Cutrell, E. (2010). The good, the bad and the random: An eye-tracking study of ad quality in Web search. In Proc. SIGIR 2010, 19--23 July, Geneva, Switzerland, pp. 42--49, ACM, NY, USA.
[3]
Cutrell, E. and Guan, Z., (2007). What are you looking for? An eye-tracking study of information usage in Web search. In Proc. CHI 2007, 30 April-03 May, San Jose, CA, USA, pp. 407--416, ACM, NY, USA.
[4]
Dogusoy, B. and Cagiltay, K. (2007). Evaluation of a Visually Categorized Search Engine. In Proc. 3rd Technology-Enhanced Learning Enlargement Workshop, September 2007, Sofia, Bulgaria, pp. 20--30, Bulgarian Sociological Association.
[5]
Ewing, K. (2005) Studying Web Pages Using Eye Tracking, Tobii Technology, http://www.scribd.com/doc/20321480/Tobii-Whitepaper-Studying-Web-Pages-Using-Eye-Tracking (1st August 2012).
[6]
Goldberg, J. H., Stimson, M. J., Lewenstein, M., Scott, N., and Wichansky, A. M., (2002). Eye tracking in web search tasks: design implications. In Proc. ETRA 2002, 25--27 March, New Orleans, USA, pp. 51--58, ACM, NY, USA.
[7]
González-Caro, C. and Marcos, MC. (2011). Different Users and Intents: An Eye-tracking Analysis of Web Search. In Proc. WSDM 2011, 9--12 February, Kowloon, Hong Kong, pp. 1--8, ACM, NY, USA.
[8]
Guan, Z. and Cutrell, E. (2007). An eye tracking study of the effect of target rank on web search. In Proc. CHI 2007, 28 April-3 May, San Jose, California, USA, pp. 417--420, ACM, NY, USA.
[9]
Lorigo, L., Pan, B., Hembrooke, H., Joachims, T., Granka, L., and Gay, G. (2006). The influence of task and gender on search evaluation and behavior using Google. IP&M, 42(4): 1123--1131.
[10]
Nettleton, D. F. and Baeza-Yates, R. (2008), Web retrieval: Techniques for the aggregation and selection of queries and answers. Int. Journal of Intelligent Systems, 23(12), 1223--1234.
[11]
Nettleton, D. F. and Codina-Filba, J. (2010), "A Cost-Continuity Model for Web Search". Springer LNAI, 6408, 219--230.
[12]
Pan, B., Hembrooke, H. A., Gay, G. K., Granka, L. A., Feusner, M. K. and Newman, J. K., (2004). The Determinants of Web Page Viewing Behavior: An Eye-Tracking Study. In Proc. 2004 Symp. on Eye tracking research & applications. 22--24 March, San Antonio, Texas, USA, pp. 147--154, ACM NY, USA.
[13]
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G. and Granka, L., (2007). In Google We Trust: Users' Decisions on Rank, Position, and Relevance. Journal of Computer-Mediated Communication, 12(3), article 3. http://jcmc.indiana.edu/vol12/issue3/pan.html (1st August 2012).
Recommendations
Search engine user behaviour: How can users be guided to quality content?
ICSTI 2007 and 2008The typical behaviour of the Web search engine user is widely known: a user only types in one or a few keywords and expects the search engine to produce relevant results in an instant. Search engines not only adapt to this behaviour. On the contrary, ...
An eye tracking study of the effect of target rank on web search
CHI '07: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWeb search engines present search results in a rank ordered list. This works when what a user wants is near the top, but sometimes the information that the user really wants is located at the bottom of the page. This study examined how users' search ...
Providing Direct Answers in Search Results: A Study of User Behavior
CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge ManagementTo study the impact of providing direct answers in search results on user behavior, we conducted a controlled user study to analyze factors including reading time, eye-tracked attention, and the influence of the quality of answer module content. We also ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
September 2012
401 pages
Publisher
BCS Learning & Development Ltd.
Swindon, United Kingdom
Publication History
Published: 10 September 2012
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 192Total Downloads
- Downloads (Last 12 months)53
- Downloads (Last 6 weeks)3
Reflects downloads up to 18 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in