More Web Proxy on the site http://driver.im/

research-article

Directing exploratory search: reinforcement learning from user interactions with keywords

Authors:

Dorota Glowacka,

Tuukka Ruotsalo,

Ksenia Konuyshkova,

kumaripaba Athukorala,

Giulio JacucciAuthors Info & Claims

IUI '13: Proceedings of the 2013 international conference on Intelligent user interfaces

Pages 117 - 128

https://doi.org/10.1145/2449396.2449413

Published: 19 March 2013 Publication History

Abstract

Techniques for both exploratory and known item search tend to direct only to more specific subtopics or individual documents, as opposed to allowing directing the exploration of the information space. We present an interactive information retrieval system that combines Reinforcement Learning techniques along with a novel user interface design to allow active engagement of users in directing the search. Users can directly manipulate document features (keywords) to indicate their interests and Reinforcement Learning is used to model the user by allowing the system to trade off between exploration and exploitation. This gives users the opportunity to more effectively direct their search nearer, further and following a direction. A task-based user study conducted with 20 participants comparing our system to a traditional query-based baseline indicates that our system significantly improves the effectiveness of information retrieval by providing access to more relevant and novel information without having to spend more time acquiring the information.

Supplementary Material

JPG File (iui0264-file3.jpg)

Download
20.86 KB

suppl.mov (iui0264-file3.mp4)

Supplemental video

Download
9.58 MB

References

[1]

Alonso, O., Baeza-Yates, R., and Gertz, M. Exploratory search using timelines. In SIGCHI 2007 Workshop on Exploratory Search and HCI Workshop, no. 1 (2007).

[2]

Auer, P. Using confidence bounds for exploitation-exploration trade-offs. Journal of Machine Learning Research 3 (2002), 397--422.

Digital Library

[3]

Auer, P., Hussain, Z., Kaski, S., A. Klami, J. Kujala, Laaksonen, J., Leung, A., Pasupa, K., and Shawe-Taylor, J. Pinview: Implicit feedback in content-based image retrieval. In JMLR Workshop and Conference Proceedings: Workshop on Application of Pattern Analysis, vol. 11 (2010), 51--57.

[4]

Balabanović, M. Exploring versus exploiting when learning user models for text recommendation. User Modeling and User-Adapted Interaction 8 (1998), 71--102.

Digital Library

[5]

Baldonado, M., and Winograd, T. Sensemaker: an information-exploration interface supporting the contextual evolution of a user's interests. In Proc. of SIGCHI (1997), 11--18.

Digital Library

[6]

Brooke, J. Sus - a quick and dirty usability scale. Usability Evaluation in Industry 189 (1996), 194.

[7]

Chapelle, O., and Li, L. An empirical evaluation of thompson sampling. In Proc. of NIPS, vol. 25 (2011).

[8]

Chau, D., Kittur, A., Hong, J., and Faloutsos, C. Apolo: making sense of large network data by combining rich user interaction and machine learning. In Proc. of SIGCHI (2011), 167--176.

Digital Library

[9]

Głowacka, D., and Shawe-Taylor, J. Content-based image retrieval with multinomial relevance feedback. In JMLR Workshop and Conference Proceedings: 2nd Asian Conference on Machine Learning, vol. 13 (2010), 111--125.

[10]

Havre, S., Hetzler, E., Perrine, K., Jurrus, E., and Miller, N. Interactive visualization of multiple query results. In Proceedings of the IEEE Symposium on Information Visualization (2001), 105.

Digital Library

[11]

Hutchins, E. L., Hollan, J. D., and Norman, D. A. Direct manipulation interfaces. Hum.-Comput. Interact. 1, 4 (Dec. 1985), 311--338.

Digital Library

[12]

Joachims, T., Freitag, D., and Mitchell, T. Webwatcher: A tour guide for the world wide web. In Proc. of IJCAI (1997).

[13]

Käki, M. Findex: search result categories help users when document ranking fails. In Proc. of SIGCHI (2005), 131--140.

Digital Library

[14]

Kelly, D., and Fu, X. Elicitation of term relevance feedback: an investigation of term source and context. In Proc. of SIGIR (2006), 453--460.

Digital Library

[15]

Kules, B., Wilson, M., Schraefel, M., and Shneiderman, B. From keyword search to exploration: How result visualization aids discovery on the web. Human-Computer Interaction Lab Technical Report HCIL-2008-06, University of Maryland (2008).

[16]

Leide, J., Cole, C., Beheshti, J., Large, A., and Lin, Y. Task-based information retrieval: Structuring undergraduate history essays for better course evaluation using essay-type visualizations. Journal of the American Society for Information Science and Technology 58, 9 (2007), 1227--1241.

Digital Library

[17]

Li, L., Chu, W., Langford, J., and Schapire, R. A contextual-bandit approach to personalized news article recommendation. In Proc. of WWW (2010).

Digital Library

[18]

Marchionini, G. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (Apr. 2006), 41--46.

Digital Library

[19]

Matejka, J., Grossman, T., and Fitzmaurice, G. Citeology: visualizing paper genealogy. In Proceedings of Human Factors in Computing Systems Extended Abstracts (2012), 181--190.

Digital Library

[20]

Pandey, S., Agarwal, D., Chakrabarti, D., and Josifovski, V. Bandits for taxonomies: A modelbased approach. In Proc. of ICDM (2007).

[21]

Pu, P., Chen, L., and Hu, R. A user-centric evaluation framework for recommender systems. In Proc. of RecSys (2011), 157--164.

Digital Library

[22]

Radlinski, F., Kleinberg, R., and Joachims, T. Learning diverse rankings with multi-armed bandits. In Proc. of ICML (2008), 784--791.

Digital Library

[23]

Seo, Y., and Zhang, B. A reinforcement learning agent for personalized information filtering. In Proc. of IUI (2000), 248--251.

Digital Library

[24]

Spärck-Jones, K. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28, 1 (1972), 11--21.

[25]

Spink, A., Wolfram, D., Jansen, M. B. J., and Saracevic, T. Searching the web: The public and their queries. Journal of the American Society for Information Science and Technology 52 (2001), 226--234.

[26]

Teevan, J., Alvarado, C., Ackerman, M. S., and Karger, D. R. The perfect search engine is not enough: a study of orienteering behavior in directed search. In Proc. of SIGCHI (2004), 415--422.

Digital Library

[27]

Terveen, L., Hill, W., and Amento, B. Constructing, organizing, and visualizing collections of topically related web resources. ACM Transactions on Computer-Human Interaction (TOCHI) 6, 1 (1999), 67--94.

Digital Library

[28]

Tombros, A., and Sanderson, M. Advantages of query biased summaries in information retrieval. In Proc. of SIGIR (1998), 2--10.

Digital Library

[29]

White, R. W., Bennett, P. N., and Dumais, S. T. Predicting short-term interests using activity-based search context. In Proc. of CIKM (2010).

Digital Library

[30]

Yee, K.-P., Swearingen, K., Li, K., and Hearst, M. Faceted metadata for image search and browsing. In Proc. of SIGCHI (2003), 401--408.

Digital Library

[31]

Yue, Y., and Joachims, T. Interactively optimizing information retrieval systems as a dueling bandits problem. In Proc. of ICML (2009).

Digital Library

[32]

Zhai, C., and Lafferty, J. A study of smoothing methods for language models applied to information retrieval. ACM Trans. Inf. Syst. 22, 2 (Apr. 2004), 179--214.

Digital Library

[33]

Zhang, B., and Seo, Y. Personalized web-document filtering using reinforcement learning. Applied Artificial Intelligence 15 (2001), 665--685.

[34]

Zhang, Y., Xu, W., and Callan, J. Exploration and exploitation in adaptive filtering based on bayesian active learning. In Proc. of ICML (2003), 896--903.

Cited By

Vidmanov DAlfimtsev A(2024)Mobile User Interface Adaptation Based on Usability Reward Model and Multi-Agent Reinforcement LearningMultimodal Technologies and Interaction10.3390/mti80400268:4(26)Online publication date: 24-Mar-2024
https://doi.org/10.3390/mti8040026
Medlar AKotkov DGłowacka D(2024)Unexplored Frontiers: A Review of Empirical Studies of Exploratory SearchACM SIGIR Forum10.1145/3687273.368727858:1(1-19)Online publication date: 7-Aug-2024
https://dl.acm.org/doi/10.1145/3687273.3687278
Hossain TShen WAntar APrabhudesai SInoue SHuan XBanovic N(2023)A Bayesian Approach for Quantifying Data Scarcity when Modeling Human Behavior via Inverse Reinforcement LearningACM Transactions on Computer-Human Interaction10.1145/355138830:1(1-27)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3551388
Show More Cited By

Index Terms

Directing exploratory search: reinforcement learning from user interactions with keywords
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Directing exploratory search with interactive intent modeling
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management

We introduce interactive intent modeling, where the user directs exploratory search by providing feedback for estimates of search intents. The estimated intents are visualized for interaction on an Intent Radar, a novel visual interface that organizes ...
Content-based book recommending using learning for text categorization
DL '00: Proceedings of the fifth ACM conference on Digital libraries

Recommender systems improve access to relevant products and information by making personalized suggestions based on previous examples of a user's likes and dislikes. Most existing recommender systems use collaborative filtering methods that base ...
A Study on User-Controllable Social Exploratory Search
IUI '18: Proceedings of the 23rd International Conference on Intelligent User Interfaces

Information-seeking tasks with learning or investigative purposes are usually referred to as exploratory search. Exploratory search unfolds as a dynamic process where the user, amidst navigation, trial-and-error and on-the-fly selections, gathers and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '13: Proceedings of the 2013 international conference on Intelligent user interfaces

March 2013

470 pages

ISBN:9781450319652

DOI:10.1145/2449396

General Chair:
Jihie Kim
University of Southern California, USA
,
Program Chairs:
Jeffrey Nichols
IBM Research -- Almaden, USA
,
Pedro Szekely
University of Southern California, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 March 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUI '13

Sponsor:

IUI '13: 18th International Conference on Intelligent User Interfaces

March 19 - 22, 2013

California, Santa Monica, USA

Acceptance Rates

IUI '13 Paper Acceptance Rate 43 of 192 submissions, 22%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

81
Total Citations
View Citations
1,334
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)5

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vidmanov DAlfimtsev A(2024)Mobile User Interface Adaptation Based on Usability Reward Model and Multi-Agent Reinforcement LearningMultimodal Technologies and Interaction10.3390/mti80400268:4(26)Online publication date: 24-Mar-2024
https://doi.org/10.3390/mti8040026
Medlar AKotkov DGłowacka D(2024)Unexplored Frontiers: A Review of Empirical Studies of Exploratory SearchACM SIGIR Forum10.1145/3687273.368727858:1(1-19)Online publication date: 7-Aug-2024
https://dl.acm.org/doi/10.1145/3687273.3687278
Hossain TShen WAntar APrabhudesai SInoue SHuan XBanovic N(2023)A Bayesian Approach for Quantifying Data Scarcity when Modeling Human Behavior via Inverse Reinforcement LearningACM Transactions on Computer-Human Interaction10.1145/355138830:1(1-27)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3551388
Brand NOdom WBarnett S(2023)Envisioning and Understanding Orientations to Introspective AI: Exploring a Design Space with Meta.AwareProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581336(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581336
Zhou ZWang WGuo MWang YGotz D(2023)A Design Space for Surfacing Content Recommendations in Visual Analytic PlatformsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.320944529:1(84-94)Online publication date: Jan-2023
https://doi.org/10.1109/TVCG.2022.3209445
Khan ARashid UAhmed N(2023)AMED: Aggregated multimedia exploratory and discovery search softwareSoftwareX10.1016/j.softx.2023.10131221(101312)Online publication date: Feb-2023
https://doi.org/10.1016/j.softx.2023.101312
Brusilovsky P(2023)AI in Education, Learner Control, and Human-AI CollaborationInternational Journal of Artificial Intelligence in Education10.1007/s40593-023-00356-z34:1(122-135)Online publication date: 21-Aug-2023
https://doi.org/10.1007/s40593-023-00356-z
Zou JHuang JRen ZKanoulas E(2022)Learning to Ask: Conversational Product Search via Representation LearningACM Transactions on Information Systems10.1145/355537141:2(1-27)Online publication date: 21-Dec-2022
https://dl.acm.org/doi/10.1145/3555371
Mahdi MAhmad ANatiq HSubhi MQassim Q(2021)Comprehensive Review and Future Research Directions on Dynamic Faceted SearchApplied Sciences10.3390/app1117811311:17(8113)Online publication date: 31-Aug-2021
https://doi.org/10.3390/app11178113
Rahdari BBrusilovsky PJavadian Sabet A(2021)Connecting Students with Research Advisors Through User-Controlled RecommendationProceedings of the 15th ACM Conference on Recommender Systems10.1145/3460231.3478879(745-748)Online publication date: 13-Sep-2021
https://dl.acm.org/doi/10.1145/3460231.3478879
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten