More Web Proxy on the site http://driver.im/

research-article

Detecting Good Abandonment in Mobile Search

Authors:

Julia Kiseleva,

Aidan C. Crook,

Ahmed Hassan Awadallah,

Madian KhabsaAuthors Info & Claims

WWW '16: Proceedings of the 25th International Conference on World Wide Web

Pages 495 - 505

https://doi.org/10.1145/2872427.2883074

Published: 11 April 2016 Publication History

Abstract

Web search queries for which there are no clicks are referred to as abandoned queries and are usually considered as leading to user dissatisfaction. However, there are many cases where a user may not click on any search result page (SERP) but still be satisfied. This scenario is referred to as good abandonment and presents a challenge for most approaches measuring search satisfaction, which are usually based on clicks and dwell time. The problem is exacerbated further on mobile devices where search providers try to increase the likelihood of users being satisfied directly by the SERP. This paper proposes a solution to this problem using gesture interactions, such as reading times and touch actions, as signals for differentiating between good and bad abandonment. These signals go beyond clicks and characterize user behavior in cases where clicks are not needed to achieve satisfaction. We study different good abandonment scenarios and investigate the different elements on a SERP that may lead to good abandonment. We also present an analysis of the correlation between user gesture features and satisfaction. Finally, we use this analysis to build models to automatically identify good abandonment in mobile search achieving an accuracy of 75%, which is significantly better than considering query and session signals alone. Our findings have implications for the study and application of user satisfaction in search systems.

References

[1]

M. S. Bernstein, J. Teevan, S. Dumais, D. Liebling, and E. Horvitz. Direct answers for search queries in the long tail. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, pages 237--246, 2012.

Digital Library

[2]

Y. Chen, Y. Liu, K. Zhou, M. Wang, M. Zhang, and S. Ma. Does Vertical Bring more Satisfaction -- Predicting Search Satisfaction in a Heterogeneous Environment. In International Conference on Information and knowledge management (to appear), 2015.

Digital Library

[3]

L. B. Chilton and J. Teevan. Addressing people's information needs directly in a web search result page. In Proceedings of the International Conference on World Wide Web, pages 27--36, 2011.

Digital Library

[4]

A. Chuklin and P. Serdyukov. Potential good abandonment prediction. In Proceedings of the International Conference Companion on World Wide Web, pages 485--486, 2012.

Digital Library

[5]

A. Chuklin and P. Serdyukov. Good abandonments in factoid queries. In International Conference Companion on World Wide Web, pages 483--484, 2012.

Digital Library

[6]

A. Diriye, R. White, G. Buscher, and S. Dumais. Leaving so soon? understanding and predicting web search abandonment rationales. In Proceedings of the 21st ACM international conference on Information and knowledge management, pages 1025--1034, 2012. ISBN 9781450311564.

Digital Library

[7]

M. Duggan and A. Smith. Cell Internet Use 2013, 2013. URL http://www.pewinternet.org/2013/09/16/cell-internet-use-2013/.

[8]

W. Fan. On the optimality of probability estimation by random decision trees. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 336--341, 2004.

Digital Library

[9]

J. L. Fleiss. Measuring nominal scale agreement among many raters. Psychological Bulletin, 76 (5): 378--382, 1971.

[10]

S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve web search. ACM Transactions on Information Systems, 23 (2): 147--168, 2005.

Digital Library

[11]

Q. Guo and E. Agichtein. Ready to buy or just browsing? detecting web searcher goals from interaction data. In Proceeding of the International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 130--137, 2010.

Digital Library

[12]

Q. Guo and E. Agichtein. Beyond dwell time: Estimating document relevance from cursor movements and other post-click searcher behavior. In Proceedings of the International conference on World Wide Web, pages 569--578, New York, New York, USA, 2012. ACM Press.

Digital Library

[13]

Q. Guo, S. Yuan, and E. Agichtein. Detecting success in mobile search from interaction. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 1229--1230, 2011.

Digital Library

[14]

Q. Guo, D. Lagun, and E. Agichtein. Predicting web search success with fine-grained interaction data. In Proceedings of the ACM International Conference on Information and Knowledge Management, pages 2050--2054, 2012.

Digital Library

[15]

Q. Guo, H. Jin, D. Lagun, S. Yuan, and E. Agichtein. Mining touch interaction data on mobile devices to predict web search result relevance. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 153--162, 2013.

Digital Library

[16]

A. Hassan. A semi-supervised approach to modeling web search satisfaction. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval., pages 275--284, 2012.

Digital Library

[17]

A. Hassan and R. W. White. Personalized models of search satisfaction. In Proceedings of the ACM international conference on Conference on information & knowledge management, pages 2009--2018, 2013.

Digital Library

[18]

A. Hassan, R. Jones, and K. L. Klinkner. Beyond dcg: User behavior as a predictor of successful search. Proceedings of the ACM International Conference on Web Search and Data Mining, pages 221--230, 2010.

Digital Library

[19]

A. Hassan, X. Shi, N. Craswell, and B. Ramsey. Beyond clicks: Query reformulation as a predictor of search satisfaction. In Proceedings of the ACM International Conference on Information and Knowledge Management, pages 2019--2028, 2013.

Digital Library

[20]

012)}HuangHCIR2012A. D. Jeff Huang. Web user interaction mining from touch-enabled mobile devices. In HCIR Workshop, 2012.

[21]

J. Jiang, A. H. Awadallah, R. Jones, U. Ozertem, I. Zitouni, R. G. Kulkarni, and O. Z. Khan. Automatic Online Evaluation of Intelligent Assistants. In Proceedings of the International Conference on World Wide Web, pages 506--516, 2015.

Digital Library

[22]

J. Jiang, A. H. Awadallah, X. Shi, and R. W. White. Understanding and Predicting Graded Search Satisfaction. In Proceedings of the ACM International Conference on Web Search and Data Mining, pages 57--66, 2015.

Digital Library

[23]

M. Kamvar, M. Kellar, R. Patel, and Y. Xu. Computers and iphones and mobile phones, oh my! In Proceedings of the International Conference on World Wide Web, pages 801--810, 2009.

Digital Library

[24]

D. Kelly. Methods for evaluating interactive information retrieval systems with users. Foundation and Trents in Information Retrieval, 3 (1--2): 1--224, 2009.

Digital Library

[25]

Y. Kim, A. Hassan, R. W. White, and Y.-M. Wang. Playing by the rules: mining query associations to predict search performance. In Proceedings of the ACM international conference on Web search and data mining, pages 133--142, 2013.

Digital Library

[26]

Y. Kim, A. Hassan, R. W. White, and I. Zitouni. Comparing client and server dwell time estimates for click-level satisfaction prediction. In Proceedings of the International ACM SIGIR Conference on Research & Development in Information Retrieval, pages 895--898, 2014.

Digital Library

[27]

Y. Kim, A. Hassan, R. W. White, and I. Zitouni. Modeling dwell time to predict click-level satisfaction. In Proceedings of the ACM International Conference on Web Search and Data Mining, pages 193--202, 2014.

Digital Library

[28]

D. Lagun, C.-H. Hsieh, D. Webster, and V. Navalpakkam. Towards better measurement of attention and satisfaction in mobile search. Proceedings of the International ACM SIGIR Conference on Research & Development in Information Retrieval, pages 113--122, 2014.

Digital Library

[29]

J. Landis and G. Koch. The measurement of observer agreement for categorical data. Biometrics, pages 159--174, 1977.

[30]

J. Li, S. Huffman, and A. Tokuda. Good abandonment in mobile and pc internet search. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 43--50, 2009.

Digital Library

[31]

Z. Liao, Y. Song, L.-w. He, and Y. Huang. Evaluating the effectiveness of search task trails. In Proceedings of the international conference on World Wide Web, pages 489--498, 2012.

Digital Library

[32]

Y. Liu, Y. Chen, J. Tang, J. Sun, M. Zhang, S. Ma, and X. Zhu. Different Users, Different Opinions: Predicting Search Satisfaction with Mouse Movement Information. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 493--502, 2015.

Digital Library

[33]

Y. Song, X. Shi, R. White, and A. H. Awadallah. Context-aware web search abandonment prediction. In Proceedings of the International ACM SIGIR Conference on Research & Development in Information Retrieval, pages 93--102, 2014.

Digital Library

[34]

S. Stamou and E. N. Efthimiadis. Interpreting user inactivity on search results. In European Conference on Information Retrieval, volume 5993, pages 100--113, 2010.

Digital Library

[35]

R. W. White, M. Richardson, and W.-t. Yih. Questions vs. Queries in Informational Search Tasks. In Proceedings of the International Conference on World Wide Web, pages 135--136, 2015.

Digital Library

Cited By

Bink MSchwarz SDraws TElsweiler D(2023)Investigating the Influence of Featured Snippets on User AttitudesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578323(211-220)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578323
Chen JZhang LLu QLiu HChen S(2023)Predicting information usefulness in health information identification from modal behaviorsInformation Processing & Management10.1016/j.ipm.2022.10322060:2(103220)Online publication date: Mar-2023
https://doi.org/10.1016/j.ipm.2022.103220
Chen MLiu CLiu ZSun JKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)LBDProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602690(33400-33413)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602690
Show More Cited By

Index Terms

Detecting Good Abandonment in Mobile Search
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals

Recommendations

Good abandonment in mobile and PC internet search
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval

Query abandonment by search engine users is generally considered to be a negative signal. In this paper, we explore the concept of good abandonment. We define a good abandonment as an abandoned query for which the user's information need was ...
Mining touch interaction data on mobile devices to predict web search result relevance
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Fine-grained search interactions in the desktop setting, such as mouse cursor movements and scrolling, have been shown valuable for understanding user intent, attention, and their preferences for Web search results. As web search on smart phones and ...
Ranking Rich Mobile Verticals based on Clicks and Abandonment
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management

We consider the problem of ranking rich verticals, which we call "cards," for a given mobile search query. Examples of card types include "SHOP" (showing access and contact information of a shop), "WEATHER" (showing a weather forecast for a particular ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

WWW '16: Proceedings of the 25th International Conference on World Wide Web

April 2016

1482 pages

ISBN:9781450341431

General Chairs:
Jacqueline Bourdeau
Tele-university (TELUQ), Montreal, QC, Canada
,
Jim A. Hendler
Rensselaer Polytechnic Institute, Troy, NY, USA
,
Roger Nkambou Nkambou
Université du Québec à Montréal, Montreal, QC, Canada
,
Program Chairs:
Ian Horrocks
University of Oxford, UK
,
Ben Y. Zhao
University of California at Santa Barbara, CA, USA

Copyright © 2016 Copyright is held by the International World Wide Web Conference Committee (IW3C2).

Sponsors

IW3C2: International World Wide Web Conference Committee

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

International World Wide Web Conferences Steering Committee

Republic and Canton of Geneva, Switzerland

Publication History

Published: 11 April 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WWW '16

Sponsor:

IW3C2

WWW '16: 25th International World Wide Web Conference

April 11 - 15, 2016

Québec, Montréal, Canada

Acceptance Rates

WWW '16 Paper Acceptance Rate 115 of 727 submissions, 16%;

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
429
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bink MSchwarz SDraws TElsweiler D(2023)Investigating the Influence of Featured Snippets on User AttitudesProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578323(211-220)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578323
Chen JZhang LLu QLiu HChen S(2023)Predicting information usefulness in health information identification from modal behaviorsInformation Processing & Management10.1016/j.ipm.2022.10322060:2(103220)Online publication date: Mar-2023
https://doi.org/10.1016/j.ipm.2022.103220
Chen MLiu CLiu ZSun JKoyejo SMohamed SAgarwal ABelgrave DCho KOh A(2022)LBDProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602690(33400-33413)Online publication date: 28-Nov-2022
https://dl.acm.org/doi/10.5555/3600270.3602690
Kashyapi SDietz L(2022)Topic-Mono-BERT: A Joint Retrieval-Clustering System for Retrieving Overview PassagesProceedings of the 14th Annual Meeting of the Forum for Information Retrieval Evaluation10.1145/3574318.3574336(54-59)Online publication date: 9-Dec-2022
https://dl.acm.org/doi/10.1145/3574318.3574336
Bink MZimmerman SElsweiler DElsweiler DKruschwitz ULudwig B(2022)Featured Snippets and their Influence on Users’ Credibility JudgementsProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505766(113-122)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505766
Ye ZXie XLiu YWang ZLi XLi JChen XZhang MMa SAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)Why Don't You ClickProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3532082(633-645)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3532082
Mehrotra RGupta AGupta RLiu YShah MRajan STang JPrakash B(2020)Learning with Limited Labels via Momentum Damped & Differentially Weighted OptimizationProceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining10.1145/3394486.3403394(3416-3425)Online publication date: 23-Aug-2020
https://dl.acm.org/doi/10.1145/3394486.3403394
Wu DZhang SO'Brien HFreund LArapakis IHoeber OLopatovska I(2020)Prediction of Good Abandonment Behavior in Mobile SearchProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3378007(407-411)Online publication date: 14-Mar-2020
https://dl.acm.org/doi/10.1145/3343413.3378007
Abualsaud MO'Brien HFreund LArapakis IHoeber OLopatovska I(2020)The Effect of Queries and Search Result Quality on the Rate of Query Abandonment in Interactive Information RetrievalProceedings of the 2020 Conference on Human Information Interaction and Retrieval10.1145/3343413.3377951(523-526)Online publication date: 14-Mar-2020
https://dl.acm.org/doi/10.1145/3343413.3377951
Zheng YMao JLiu YLuo CZhang MMa S(2019)Constructing Click Model for Mobile Search with Viewport TimeACM Transactions on Information Systems10.1145/336048637:4(1-34)Online publication date: 26-Sep-2019
https://dl.acm.org/doi/10.1145/3360486
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents