[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.5555/1273073.1273141dlproceedingsArticle/Chapter ViewAbstractPublication PagescolingConference Proceedingsconference-collections
Article
Free access

The role of information retrieval in answering complex questions

Published: 17 July 2006 Publication History

Abstract

This paper explores the role of information retrieval in answering "relationship" questions, a new class complex information needs formally introduced in TREC 2005. Since information retrieval is often an integral component of many question answering strategies, it is important to understand the impact of different term-based techniques. Within a framework of sentence retrieval, we examine three factors that contribute to question answering performance: the use of different retrieval engines, relevance (both at the document and sentence level), and redundancy. Results point out the limitations of purely term-based methods to this challenging task. Nevertheless, IR-based techniques provide a strong baseline on top of which more sophisticated language processing techniques can be deployed.

References

[1]
J. Allan, C. Wade, and A. Bolivar. 2003. Retrieval and novelty detection at the sentence level. In SIGIR 2003.
[2]
E. Amigó, J. Gonzalo, V. Peinado, A. Peñas, and F. Verdejo. 2004. An empirical study of information synthesis task. In ACL 2004.
[3]
C. Buckley and E. Voorhees. 2004. Retrieval evaluation with incomplete information. In SIGIR 2004.
[4]
J. Callan. 1994. Passage-level evidence in document retrieval. In SIGIR 1994.
[5]
H. Cui, M.-Y. Kan, and T.-S. Chua. 2005. Generic soft pattern models for definitional question answering. In SIGIR 2005.
[6]
H. Dang. 2005. Overview of DUC 2005. In DUC 2005.
[7]
R. Gaizauskas, M. Hepple, and M. Greenwood. 2004. Proceedings of the SIGIR 2004 Workshop on Information Retrieval for Question Answering (IR4QA).
[8]
J. Goldstein, V. Mittal, J. Carbonell, and J. Callan. 2000. Creating and evaluating multi-document sentence extract summaries. In CIKM 2000.
[9]
D. Harman. 2002. Overview of the TREC 2002 novelty track. In TREC 2002.
[10]
W. Hildebrandt, B. Katz, and J. Lin. 2004. Answering definition questions with multiple knowledge sources. In HLT/NAACL 2004.
[11]
L. Hirschman and R. Gaizauskas. 2001. Natural language question answering: The view from here. Natural Language Engineering, 7(4):275--300.
[12]
B. Katz, G. Marton, G. Borchardt, A. Brownell, S. Felshin, D. Loreto, J. Louis-Rosenberg, B. Lu, F. Mora, S. Stiller, O. Uzuner, and A. Wilcox. 2005. External knowledge sources for question answering. In TREC 2005.
[13]
J. Lin and D. Demner-Fushman. 2005. Automatically evaluating answers to definition questions. In HLT/EMNLP 2005.
[14]
J. Lin and D. Demner-Fushman. 2006a. The role of knowledge in conceptual retrieval: A study in the domain of clinical medicine. In SIGIR 2006.
[15]
J. Lin and D. Demner-Fushman. 2006b. Will pyramids built of nuggets topple over? In HLT/NAACL 2006.
[16]
G. Marton and A. Radul. 2006. Nuggeteer: Automatic nugget-based evaluation using descriptions and judgements. In HLT/NAACL 2006.
[17]
C. Monz. 2003. From Document Retrieval to Question Answering. Ph.D. thesis, Institute for Logic, Language, and Computation, University of Amsterdam.
[18]
S. Narayanan and S. Harabagiu. 2004. Question answering based on semantic structures. In COLING 2004.
[19]
J. Prager, J. Chu-Carroll, and K. Czuba. 2004. Question answering using constraint satisfaction: QA-by-Dossier-with-Constraints. In ACL 2004.
[20]
G. Salton and C. Buckley. 1990. Improving retrieval performance by relevance feedback. Journal of the American Society for Information Science, 41(4):288--297.
[21]
S. Tellex, B. Katz, J. Lin, G. Marton, and A. Fernandes. 2003. Quantitative evaluation of passage retrieval algorithms for question answering. In SIGIR 2003.
[22]
E. Voorhees. 2003. Overview of the TREC 2003 question answering track. In TREC 2003.
[23]
E. Voorhees. 2005. Overview of the TREC 2005 question answering track. In TREC 2005.
[24]
J. Xu, R. Weischedel, and A. Licuanan. 2004. Evaluation of an extraction-based approach to answering definition questions. In SIGIR 2004.

Cited By

View all
  • (2008)Passage relevance models for genomics searchProceedings of the 2nd international workshop on Data and text mining in bioinformatics10.1145/1458449.1458461(45-52)Online publication date: 30-Oct-2008
  • (2007)Indexing low frequency information for question answeringLarge Scale Semantic Access to Content (Text, Image, Video, and Sound)10.5555/1931390.1931453(659-664)Online publication date: 30-May-2007
  1. The role of information retrieval in answering complex questions

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image DL Hosted proceedings
    COLING-ACL '06: Proceedings of the COLING/ACL on Main conference poster sessions
    July 2006
    992 pages

    Publisher

    Association for Computational Linguistics

    United States

    Publication History

    Published: 17 July 2006

    Qualifiers

    • Article

    Acceptance Rates

    COLING-ACL '06 Paper Acceptance Rate 126 of 126 submissions, 100%;
    Overall Acceptance Rate 1,537 of 1,537 submissions, 100%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)30
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 12 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2008)Passage relevance models for genomics searchProceedings of the 2nd international workshop on Data and text mining in bioinformatics10.1145/1458449.1458461(45-52)Online publication date: 30-Oct-2008
    • (2007)Indexing low frequency information for question answeringLarge Scale Semantic Access to Content (Text, Image, Video, and Sound)10.5555/1931390.1931453(659-664)Online publication date: 30-May-2007

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media