More Web Proxy on the site http://driver.im/

Article

Question answering passage retrieval using dependency relations

Authors:

Tat-Seng ChuaAuthors Info & Claims

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 400 - 407

https://doi.org/10.1145/1076034.1076103

Published: 15 August 2005 Publication History

Abstract

State-of-the-art question answering (QA) systems employ term-density ranking to retrieve answer passages. Such methods often retrieve incorrect passages as relationships among question terms are not considered. Previous studies attempted to address this problem by matching dependency relations between questions and answers. They used strict matching, which fails when semantically equivalent relationships are phrased differently. We propose fuzzy relation matching based on statistical models. We present two methods for learning relation mapping scores from past QA pairs: one based on mutual information and the other on expectation maximization. Experimental results show that our method significantly outperforms state-of-the-art density-based passage retrieval methods by up to 78% in mean reciprocal rank. Relation matching also brings about a 50% improvement in a system enhanced by query expansion.

References

[1]

Y. Al-Onaizan, J. Curin, M. Jahr, K. Knight, J. Lafferty, D. Melamed, F. Och, D. Purdy, N. Smith, and D. Yarowsky, Statistical machine translation, Final Report, JHU Summer Workshop, 1999.

[2]

G. Attardi, A. Cisternino, F. Formica, M. Simi and A. Tommasi, PiQASso: Pisa Question Answering System, Proc. of TREC-2001, 2001, pp. 599--607.

[3]

A. Berger and J. Lafferty, Information retrieval as statistical translation, Proc. of SIGIR '99, 1999, pp. 222--229.

Digital Library

[4]

P. Brown, S. Della, V. Della Pietra and R. Mercer, The mathematics of statistical machine translation: Parameter estimation, Computational Linguistics, 19(2), 1993, pp. 263--311.

Digital Library

[5]

H. Cui, K. Li, R. Sun, T.-S. Chua and M.-Y. Kan, National University of Singapore at the TREC-13 Question Answering Main Task, Proc. of TREC-13, 2004.

[6]

A. Echihabi and D. Marcu, A noisy-channel approach for question answering, Proc. of ACL '03, 2003.

Digital Library

[7]

J. Gao, J.-Y. Nie, G. Wu and G. Cao, Dependency language model for information retrieval, Proc. of SIGIR '04, Sheffield, UK, 2004, pp. 170--177.

Digital Library

[8]

S. Harabagiu, D. Moldovan, C. Clark, M. Bowden, J. Williams and J. Bensley, Answer Mining by Combining Extraction Techniques with Abductive Reasoning, Proc. of TREC-12, 2003, pp. 375--382.

[9]

D. Hull, Using statistical testing in the evaluation of retrieval experiments, Proc. of SIGIR '93, 1993.

Digital Library

[10]

A. Ittycheriah, M. Franz, and S. Roukos, IBM's statistical question answering system - TREC-10, Proc. of TREC-10, 2001.

[11]

M. Kaszkeil and J. Zobel, Passage retrieval revisited, Proc. of SIGIR '97, Philadelphia, PA, USA, 1997, pp. 178--185.

Digital Library

[12]

B. Katz and J. Lin, Selectively Using Relations to Improve Precision in Question Answering, Proc. of the EACL-2003 Workshop on Natural Language Processing for Question Answering, April 2003.

[13]

G. G. Lee, J. Seo, S. Lee, H. Jung, B.-H. Cho, C. Lee, B.-K. Kwak, J. Cha, D. Kim, J. An, H. Kim, and K. Kim, SiteQ: Engineering high performance QA system using lexico-semantic pattern matching and shallow NLP, Proc. of TREC-10, 2001, pp. 442--451.

[14]

M. Light, G. S. Mann, E. Riloff, and E. Breck, Analyses for elucidating current question answering technology, Journal of Natural Language Engineering, Special Issue on Question Answering, Fall--Winter, 2001.

Digital Library

[15]

D. Lin, Dependency-based Evaluation of MINIPAR, Proc. of Workshop on the Evaluation of Parsing Systems, Granada, Spain, May, 1998.

[16]

J. Lin, D. Quan, V. Sinha, K. Bakshi, D. Huynh, B. Katz and D. R. Karger, What makes a good answer? The role of context in question answering, Proc. of the ninth IFIP TC13 International Conference on Human-Computer Interaction, 2003.

[17]

D. Lin and P. Pantel, Discovery of Inference Rules for Question Answering, Natural Language Engineering, 2001, 7(4): pp. 343--360.

Digital Library

[18]

F. Song and B. Croft, A general language model for information retrieval, Proc. of CIKM'99, 1999, pp. 316--321.

Digital Library

[19]

S. Tellex, B. Katz, J. Lin, A.Fernandes and G.Marton, Quantitative evaluation of passage retrieval algorithms for question answering, Proc. of SIGIR '03, 2003, Toronto, Canada, pp. 41--47.

Digital Library

[20]

E.M. Voorhees, Overview of the TREC 2003 Question Answering Track, Proc. of TREC-12, pp. 54--68.

Cited By

Yang DRao JChen KGuo XZhang YYang JZhang YHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner MonologuesProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657760(730-740)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657760
C NB A(2024)Comparative Methods of Implementation for Different Question Answering Systems2024 5th International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV)10.1109/ICICV62344.2024.00096(567-575)Online publication date: 11-Mar-2024
https://doi.org/10.1109/ICICV62344.2024.00096
Yang YHe WGao CXu ZXia XLiu C(2023)TopicAns: Topic-informed Architecture for Answer Recommendation on Technical Q&A SiteACM Transactions on Software Engineering and Methodology10.1145/360718933:1(1-25)Online publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1145/3607189
Show More Cited By

Index Terms

Question answering passage retrieval using dependency relations

Recommendations

Quantitative evaluation of passage retrieval algorithms for question answering
SIGIR '03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval

Passage retrieval is an important component common to many question answering systems. Because most evaluations of question answering systems focus on end-to-end performance, comparison of common components becomes difficult. To address this shortcoming,...
Mining dependency relations for query expansion in passage retrieval
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

Classical query expansion techniques such as the local context analysis (LCA) make use of term co-occurrence statistics to incorporate additional contextual terms for enhancing passage retrieval. However, relevant contextual terms do not always co-occur ...
Passage Reranking for Question Answering Using Syntactic Structures and Answer Types
ECIR 2011: Proceedings of the 33rd European Conference on Advances in Information Retrieval - Volume 6611

Passage Retrieval is a crucial step in question answering systems, one that has been well researched in the past. Due to the vocabulary mismatch problem and independence assumption of bag-of-words retrieval models, correct passages are often ranked lower ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

August 2005

708 pages

ISBN:1595930345

DOI:10.1145/1076034

General Chairs:
Ricardo Baeza-Yates
University of Chile, Chile
,
Nivio Ziviani
Federal University of Minas Gerais, Brazil
,
Program Chairs:
Gary Marchionini
University of North Carolina, USA
,
Alistair Moffat
University of Melbourne, Australia
,
John Tait
University of Sunderland, UK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 August 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR05

Sponsor:

SIGIR

SIGIR05: The 28th ACM/SIGIR International Symposium on Information Retrieval 2005

August 15 - 19, 2005

Salvador, Brazil

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

118
Total Citations
View Citations
1,933
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang DRao JChen KGuo XZhang YYang JZhang YHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner MonologuesProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657760(730-740)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657760
C NB A(2024)Comparative Methods of Implementation for Different Question Answering Systems2024 5th International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV)10.1109/ICICV62344.2024.00096(567-575)Online publication date: 11-Mar-2024
https://doi.org/10.1109/ICICV62344.2024.00096
Yang YHe WGao CXu ZXia XLiu C(2023)TopicAns: Topic-informed Architecture for Answer Recommendation on Technical Q&A SiteACM Transactions on Software Engineering and Methodology10.1145/360718933:1(1-25)Online publication date: 11-Jul-2023
https://dl.acm.org/doi/10.1145/3607189
R RB GJ S J(2023)A Comprehensive Review on Deep Learning Approaches for Question Answering and Machine Reading Comprehension in NLP2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON)10.1109/DELCON57910.2023.10127327(1-6)Online publication date: 24-Feb-2023
https://doi.org/10.1109/DELCON57910.2023.10127327
Taufiq UPulungan RSuyanto Y(2023)Named entity recognition and dependency parsing for better concept extraction in summary obfuscation detectionExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.119579217:COnline publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.eswa.2023.119579
Shao YChe WLiu TDing Y(2023)The Construction of a Chinese Semantic Dependency Graph BankChinese Language Resources10.1007/978-3-031-38913-9_13(211-226)Online publication date: 19-Dec-2023
https://doi.org/10.1007/978-3-031-38913-9_13
Boroujeni GFaili HYaghoobzadeh YAlam MBuscaldi DCochez MOsborne FRefogiato Recupero DSack H(2022)Answer selection in community question answering exploiting knowledge graph and context informationSemantic Web10.3233/SW-22297013:3(339-356)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.3233/SW-222970
Zhu HTiwari PGhoneim AHossain M(2022)A Collaborative AI-Enabled Pretrained Language Model for AIoT Domain Question AnsweringIEEE Transactions on Industrial Informatics10.1109/TII.2021.309718318:5(3387-3396)Online publication date: May-2022
https://doi.org/10.1109/TII.2021.3097183
Truong CPham TPhan MLe NNguyen TNguyen Q(2022)Converting a constituency treebank to dependency treebank for Vietnamese2022 RIVF International Conference on Computing and Communication Technologies (RIVF)10.1109/RIVF55975.2022.10013806(256-261)Online publication date: 20-Dec-2022
https://doi.org/10.1109/RIVF55975.2022.10013806
Mao RLi XGe MCambria E(2022)MetaPro: A computational metaphor processing model for text pre-processingInformation Fusion10.1016/j.inffus.2022.06.00286-87(30-43)Online publication date: Oct-2022
https://doi.org/10.1016/j.inffus.2022.06.002
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents