research-article

Ambiguous requests: implications for retrieval tests, systems and theories

Authors:

Karen Spärck-Jones,

Stephen E. Robertson,

Mark SandersonAuthors Info & Claims

ACM SIGIR Forum, Volume 41, Issue 2

Pages 8 - 17

https://doi.org/10.1145/1328964.1328965

Published: 01 December 2007 Publication History

Get Access

Abstract

Retrieval system experimentation has assumed that user requests represent a single information need. The problem is identifying and meeting this need. Search engine experience demonstrates that this assumption is far from holding in the real world. Responding appropriately to this fact raises new issues for research on retrieval system theory, design, and evaluation.

References

[1]

Broder, A. 'A taxonomy of web search', ACM SIGIR Forum, 2002.

Digital Library

Google Scholar

[2]

Carbonell, J. and Goldstein, J. 'The use of diversity based reranking for reordering documents and producing summaries', SIGIR, 1998, 335--336.

Digital Library

Google Scholar

[3]

Chen, H. and Karger, D. 'Less is more: probabilistic models for retrieving fewer relevant documents', SIGIR, 2006, 429--436.

Digital Library

Google Scholar

[4]

Croft, W. B. (Ed.), Advances in information retrieval, Dordrecht: Kluwer, 2000, 1--36.

Digital Library

Google Scholar

[5]

Spärck Jones, K., Walker, S. and Robertson, S. E., 'A probabilistc model of information retrieval: development and comparative experiments', Parts 1 and 2, Information Processing and Management, 36, 2000, 779--808 and 809--840.

Digital Library

Google Scholar

[6]

Voorhees, E. M. 'Question answering in TREC', in TREC. Experiment and evaluation in information retrieval, Ed. E. M. Voorhees and D. K. Harman, Cambridge, MA: MITP Press, 2005, 233--257.

Google Scholar

[7]

Robertson, S. E. 'The probability ranking principle in IR', Journal of Documentation, 33, 1977, 130--137.

Crossref

Google Scholar

[8]

Voorhees, E. M. and Harman D. K. (Eds.) TREC. Experiment and evaluation in information retrieval, Cambridge, MA: MIT Press, 2005.

Digital Library

Google Scholar

[9]

Zhai, C., Cohen, W. W. and Lafferty, J. 'Beyond independent relevance: methods and evaluation metrics for subtopic retrieval', SIGIR, 2003, 10--17.

Digital Library

Google Scholar

Cited By

View all

Hlaoua L(2024)An overview of aggregation methods for social networks analysisKnowledge and Information Systems10.1007/s10115-024-02296-z67:1(1-28)Online publication date: 12-Dec-2024
https://doi.org/10.1007/s10115-024-02296-z
Rashidi KSotudeh HNikseresht A(2022)Comment-enriched index terms improve the relevance and novelty of the ranking of the commented medical articles retrieved by an NLP systemOnline Information Review10.1108/OIR-05-2022-028347:6(1155-1167)Online publication date: 29-Dec-2022
https://doi.org/10.1108/OIR-05-2022-0283
McDonald GMacdonald COunis I(2021)Search results diversification for effective fair ranking in academic searchInformation Retrieval10.1007/s10791-021-09399-z25:1(1-26)Online publication date: 7-Dec-2021
https://dl.acm.org/doi/10.1007/s10791-021-09399-z
Show More Cited By

Index Terms

Ambiguous requests: implications for retrieval tests, systems and theories
1. Information systems
  1. Information retrieval
  2. Information storage systems
2. Theory of computation
  1. Design and analysis of algorithms
    1. Data structures design and analysis
      1. Sorting and searching

Recommendations

Factors Influencing Users’ Information Requests: Medium, Target, and Extra-Topical Dimension

We report on a crowdsourced study that investigated how two factors influence the way people formulate information requests. Our first factor, medium, considers whether the request is produced using text or voice. Our second factor, target, considers ...
Combining ambiguous evidence with respect to ambiguous a priori knowledge. I. Boolean logic

This paper describes conditioned Dempster-Shafer (CDS) theory, a probabilistic calculus for dealing with possibly non-Bayesian evidence when the underlying a priori knowledge base is possibly non-Bayesian. Specifically, we show that the Dempster-Shafer ...
Implementing recoverable requests using queues

Transactions have been rigorously defined and extensively studied in the database and transaction processing literature, but little has been said about the handling of the requests for transaction execution in commercial TP systems, especially ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGIR Forum Volume 41, Issue 2

December 2007

120 pages

ISSN:0163-5840

DOI:10.1145/1328964

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2007

Published in SIGIR Volume 41, Issue 2

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

48
Total Citations
View Citations
597
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Hlaoua L(2024)An overview of aggregation methods for social networks analysisKnowledge and Information Systems10.1007/s10115-024-02296-z67:1(1-28)Online publication date: 12-Dec-2024
https://doi.org/10.1007/s10115-024-02296-z
Rashidi KSotudeh HNikseresht A(2022)Comment-enriched index terms improve the relevance and novelty of the ranking of the commented medical articles retrieved by an NLP systemOnline Information Review10.1108/OIR-05-2022-028347:6(1155-1167)Online publication date: 29-Dec-2022
https://doi.org/10.1108/OIR-05-2022-0283
McDonald GMacdonald COunis I(2021)Search results diversification for effective fair ranking in academic searchInformation Retrieval10.1007/s10791-021-09399-z25:1(1-26)Online publication date: 7-Dec-2021
https://dl.acm.org/doi/10.1007/s10791-021-09399-z
Shajalal MAono M(2020)Coverage-based query subtopic diversification leveraging semantic relevanceKnowledge and Information Systems10.1007/s10115-020-01470-362:7(2873-2891)Online publication date: 27-Apr-2020
https://doi.org/10.1007/s10115-020-01470-3
Pagani FFedorov OBalzarotti D(2019)Introducing the Temporal Dimension to Memory ForensicsACM Transactions on Privacy and Security10.1145/331035522:2(1-21)Online publication date: 18-Mar-2019
https://dl.acm.org/doi/10.1145/3310355
Kwon DYi HCho YPaek Y(2019)Safe and Efficient Implementation of a Security System on ARM using Intra-level Privilege SeparationACM Transactions on Privacy and Security10.1145/330969822:2(1-30)Online publication date: 26-Feb-2019
https://dl.acm.org/doi/10.1145/3309698
Steiner M(2019)The Influence of Backstories on Queries with Varying Levels of Intent in Task-Based Specialised Information RetrievalAdvances in Information Retrieval10.1007/978-3-030-15719-7_52(375-379)Online publication date: 14-Apr-2019
https://dl.acm.org/doi/10.1007/978-3-030-15719-7_52
Azimi RFox TGonzalez WReda S(2018)Scale-Out vs Scale-UpACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/32321623:4(1-23)Online publication date: 22-Aug-2018
https://dl.acm.org/doi/10.1145/3232162
(2018)Ensuring Persistent Content in Opportunistic Networks via Stochastic Stability AnalysisACM Transactions on Modeling and Performance Evaluation of Computing Systems10.1145/32321613:4(1-23)Online publication date: 25-Aug-2018
https://dl.acm.org/doi/10.1145/3232161
Shajalal MAono MAzim M(2018)Aspect-based Query Expansion for Search Results Diversification2018 Joint 7th International Conference on Informatics, Electronics & Vision (ICIEV) and 2018 2nd International Conference on Imaging, Vision & Pattern Recognition (icIVPR)10.1109/ICIEV.2018.8641004(147-152)Online publication date: Jul-2018
https://doi.org/10.1109/ICIEV.2018.8641004
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Factors Influencing Users’ Information Requests: Medium, Target, and Extra-Topical Dimension

Combining ambiguous evidence with respect to ambiguous a priori knowledge. I. Boolean logic

Implementing recoverable requests using queues

Comments

Information

Published In

Publisher

Publication History

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations