More Web Proxy on the site http://driver.im/

research-article

Seeing is retrieving: building information context from what the user sees

Authors:

Karl Gyllstrom,

Craig SoulesAuthors Info & Claims

IUI '08: Proceedings of the 13th international conference on Intelligent user interfaces

Pages 189 - 198

https://doi.org/10.1145/1378773.1378798

Published: 13 January 2008 Publication History

Abstract

As the user's document and application workspace grows more diverse, supporting personal information management becomes increasingly important. This trend toward diversity renders it difficult to implement systems which are tailored to specific applications, file types, or other information sources.

We developed SeeTrieve, a personal document retrieval and classification system which abstracts applications by considering only the text they present to the user through the user interface. Associating the visible text which surrounds a document in time, SeeTrieve is able to identify important information about the task within which a document is used. This context enables novel, useful ways for users to retrieve their personal documents. When compared to content based systems, this context based retrieval achieved substantial improvements in document recall.

References

[1]

R. A. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1999.

Digital Library

[2]

D. K. Barreau. Context as a factor in personal information management systems. Journal of the American Society for Information Science, 46(5):327--339, 1995.

Digital Library

[3]

T. Bauer and D. Leake. Using document access sequences to recommend customized information. Intelligent Systems, IEEE, 17(6):27--33, 2002.

Digital Library

[4]

T. Blanc-Brude and D. L. Scapin. What do people recall about their documents? Implications for desktop search tools. In IUI '07, pages 102--111, New York, NY, USA, 2007. ACM Press.

Digital Library

[5]

J. Budzik and K. J. Hammond. User interactions with everyday applications as context for just-in-time information access. In IUI '00, pages 44--51, New York, NY, USA, 2000. ACM Press.

Digital Library

[6]

P. Chirita, C. S. Firan, and W. Nejdl. Personalized query expansion for the web. In SIGIR '07, pages 7--14, New York, NY, USA, 2007. ACM Press.

Digital Library

[7]

E. Cutrell, S. T. Dumais, and J. Teevan. Searching to eliminate personal information management. Commun. ACM, 49(1):58--64, 2006.

Digital Library

[8]

Google Desktop. http://desktop.google.com.

[9]

Yahoo! Desktop. http://desktop.yahoo.com.

[10]

S. Dumais, E. Cutrell, JJ Cadiz, G. Jancke, R. Sarin, and D. C. Robbins. Stuff I've seen: a system for personal information retrieval and re-use. In SIGIR '03, pages 72--79, New York, NY, USA, 2003. ACM Press.

Digital Library

[11]

D. Elsweiler and I. Ruthven. Towards task-based personal information management evaluations. In SIGIR '07, pages 23--30, New York, NY, USA, 2007. ACM Press.

Digital Library

[12]

K. Eshghi and H. K. Tang. A framework for analyzing and improving content-based chunking algorithms. Technical Report 30, Hewlett-Packard Labs, 2005.

[13]

X. Fu, J. Budzik, and K. J. Hammond. Mining navigation history for recommendation. In IUI '00, pages 106--112, New York, NY, USA, 2000. ACM Press.

Digital Library

[14]

K. Gyllstrom, C. Soules, and A. Veitch. Confluence: enhancing contextual desktop search. In SIGIR '07, pages 717--718, New York, NY, USA, 2007. ACM Press.

Digital Library

[15]

D. M. Hilbert and D. F. Redmiles. Extracting usability information from user interface events. ACM Computing Surveys, 32(4):384--421, 2000.

Digital Library

[16]

Indri. http://www.lemurproject.org/indri/.

[17]

V. Kaptelinin. Umea: translating interaction histories into project contexts. In CHI '03, pages 353--360, New York, NY, USA, 2003. ACM Press.

Digital Library

[18]

D. Karger, K. Bakshi, D. Huynh, D. Quan, and V. Sinha. Haystack: A General Purpose Information Management Tool for End Users of Semistructured Data. In CIDR, 2005.

[19]

D. Kelly. Evaluating personal information management behaviors and tools. Commun. ACM, 49(1):84--86, 2006.

Digital Library

[20]

Microsoft Office Live. http://office.microsoft.com/en-us/officelive.

[21]

Google Mail. http://mail.google.com.

[22]

N. Oliver, G. Smith, C. Thakkar, and A. C. Surendran. SWISH: semantic analysis of window titles and switching history. In IUI '06, pages 194--201, New York, NY, USA, 2006. ACM Press.

Digital Library

[23]

T. Rattenbury and J. Canny. Caad: an automatic task support system. In CHI '07, pages 687--696, New York, NY, USA, 2007. ACM Press.

Digital Library

[24]

J. Shen, L. Li, T. G. Dietterich, and J. L. Herlocker. A hybrid learning system for recognizing user tasks from desktop activities and email messages. In IUI '06, pages 86--92, New York, NY, USA, 2006. ACM Press.

Digital Library

[25]

C. A. N. Soules and G. R. Ganger. Connections: using context to enhance file search. In SOSP '05, pages 119--132, New York, NY, USA, 2005. ACM Press.

Digital Library

[26]

Mac OS X Spotlight. http://www.apple.com/macosx/features/spotlight/.

[27]

K. Sugiyama, K. Hatano, and M. Yoshikawa. Adaptive web search based on user profile constructed without any effort from users. In WWW '04, pages 675--684, New York, NY, USA, 2004. ACM Press.

Digital Library

[28]

J. Teevan, S. T. Dumais, and E. Horvitz. Personalizing search via automated analysis of interests and activities. In SIGIR '05, pages 449--456, New York, NY, USA, 2005. ACM Press.

Digital Library

[29]

R. W. White and D. Kelly. A study on the effects of personalization and task information on implicit feedback performance. In CIKM '06, pages 297--306, New York, NY, USA, 2006. ACM Press.

Digital Library

Cited By

Jacucci GDaee PVuong TAndolina SKlouche KSjöberg MRuotsalo TKaski S(2021)Entity Recommendation for Everyday Digital TasksACM Transactions on Computer-Human Interaction10.1145/345891928:5(1-41)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3458919
Francese RRisi MTortora G(2019)A Multi-device Cloud-Based Personal Event Management SystemGreen, Pervasive, and Cloud Computing10.1007/978-3-030-19223-5_14(192-207)Online publication date: 26-May-2019
https://dl.acm.org/doi/10.1007/978-3-030-19223-5_14
Sappelli MVerberne SKraaij W(2016)Adapting the Interactive Activation Model for Context Recognition and IdentificationACM Transactions on Interactive Intelligent Systems10.1145/28730676:3(1-30)Online publication date: 14-Sep-2016
https://dl.acm.org/doi/10.1145/2873067
Show More Cited By

Index Terms

Seeing is retrieving: building information context from what the user sees
1. Information systems
  1. Information retrieval

Recommendations

Improving query and result list adaptation in personalized multilingual information retrieval
SIGIR '11: Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval

A general characteristic of Information Retrieval (IR) and Multilingual IR (MIR) [5] systems is that if the same query was submitted by different users, the system would yield the same results, regardless of the user. On the other hand, Adaptive ...
Information at your fingertips: contextual IR in enterprise email
IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

We present ICARUS, a contextual information retrieval system, which uses the current email message and a multi-tiered user model to retrieve relevant content and make it available in a sidebar widget embedded in the email client. The system employs a ...
Activity put in context: identifying implicit task context within the user's document interaction
IIiX '08: Proceedings of the second international symposium on Information interaction in context

Modern desktop search is ill-fitted to our personal document workspace. On one hand, many of the methods which render web search effective cannot be applied on the desktop. On the other, desktop search does not take full advantage of attributes that are ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '08: Proceedings of the 13th international conference on Intelligent user interfaces

January 2008

458 pages

ISBN:9781595939876

DOI:10.1145/1378773

General Chair:
Steffen Staab
Universitat Koblenz-Landau, Germany

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence
ACM: Association for Computing Machinery
SIGCHI: ACM Special Interest Group on Computer-Human Interaction
AAAI: Association for the Advancement of Artifical Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 January 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUI08

Sponsor:

IUI08: 13th International Conference on Intelligent User Interfaces

January 13 - 16, 2008

Gran Canaria, Spain

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
612
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)3

Reflects downloads up to 10 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jacucci GDaee PVuong TAndolina SKlouche KSjöberg MRuotsalo TKaski S(2021)Entity Recommendation for Everyday Digital TasksACM Transactions on Computer-Human Interaction10.1145/345891928:5(1-41)Online publication date: 20-Aug-2021
https://dl.acm.org/doi/10.1145/3458919
Francese RRisi MTortora G(2019)A Multi-device Cloud-Based Personal Event Management SystemGreen, Pervasive, and Cloud Computing10.1007/978-3-030-19223-5_14(192-207)Online publication date: 26-May-2019
https://dl.acm.org/doi/10.1007/978-3-030-19223-5_14
Sappelli MVerberne SKraaij W(2016)Adapting the Interactive Activation Model for Context Recognition and IdentificationACM Transactions on Interactive Intelligent Systems10.1145/28730676:3(1-30)Online publication date: 14-Sep-2016
https://dl.acm.org/doi/10.1145/2873067
Vianna DYong AXia CMarian ANguyen T(2014)A tool for personal data extraction2014 IEEE 30th International Conference on Data Engineering Workshops10.1109/ICDEW.2014.6818307(80-83)Online publication date: Mar-2014
https://doi.org/10.1109/ICDEW.2014.6818307
Guo QAgichtein EMille AGandon FMisselis JRabinovich MStaab S(2012)Beyond dwell timeProceedings of the 21st international conference on World Wide Web10.1145/2187836.2187914(569-578)Online publication date: 16-Apr-2012
https://dl.acm.org/doi/10.1145/2187836.2187914
Karlson ASmith GLee BTan DFitzpatrick GGutwin CBegole BKellogg W(2011)Which version is this?Proceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1978942.1979334(2669-2678)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1978942.1979334
Margo DSeltzer MCheney J(2009)The case for browser provenanceFirst workshop on on Theory and practice of provenance10.5555/1525932.1525941(1-5)Online publication date: 23-Feb-2009
https://dl.acm.org/doi/10.5555/1525932.1525941
Buscher Gvan Elst LDengel AAllan JAslam JSanderson MZhai CZobel J(2009)Segment-level display time as implicit feedbackProceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval10.1145/1571941.1571955(67-74)Online publication date: 19-Jul-2009
https://dl.acm.org/doi/10.1145/1571941.1571955
Gyllstrom KConati CBauer MOliver NWeld D(2009)Passages through timeProceedings of the 14th international conference on Intelligent user interfaces10.1145/1502650.1502673(147-156)Online publication date: 8-Feb-2009
https://dl.acm.org/doi/10.1145/1502650.1502673
Lu JZhou MConati CBauer MOliver NWeld D(2009)An interactive, smart notepad for context-sensitive information seekingProceedings of the 14th international conference on Intelligent user interfaces10.1145/1502650.1502671(127-136)Online publication date: 8-Feb-2009
https://dl.acm.org/doi/10.1145/1502650.1502671
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents