More Web Proxy on the site http://driver.im/

research-article

Finding question-answer pairs from online forums

Authors:

Yueheng SunAuthors Info & Claims

SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

Pages 467 - 474

https://doi.org/10.1145/1390334.1390415

Published: 20 July 2008 Publication History

Abstract

Online forums contain a huge amount of valuable user generated content. In this paper we address the problem of extracting question-answer pairs from forums. Question-answer pairs extracted from forums can be used to help Question Answering services (e.g. Yahoo! Answers) among other applications. We propose a sequential patterns based classification method to detect questions in a forum thread, and a graph based propagation method to detect answers for questions in the same thread. Experimental results show that our techniques are very promising.

References

[1]

A. L. Berger, R. Caruana, D. Cohn, D. Freitag, and V. O. Mittal. Bridging the lexical chasm: statistical approaches to answer-finding. In Proc. of SIGIR, 2000.

Digital Library

[2]

S. Brin and L. Page. The anatomy of a large-scale hypertextual web search engine. In Proc. of WWW7, 1998.

Digital Library

[3]

H. T. Dang, J. Lin, and D. Kelly. Overview of the trec 2007 question answering track. In Proc. of TREC, 2007.

[4]

S. Ding, G. Cong, C.-Y. Lin, and X. Zhu. Using conditional random fields to extract contexts and answers of questions from online forums. In ACL, 2008.

[5]

D. Feng, E. Shaw, J. Kim, and E. Hovy. An intelligent discussion-bot for answering student queries in threaded discussions. In Proc. of Intelligent user interfaces, 2006.

Digital Library

[6]

S. M. Harabagiu and A. Hickl. Methods for using textual entailment in open-domain question answering. In Proc. of ACL, 2006.

Digital Library

[7]

J. Huang, M. Zhou, and D. Yang. Extracting chatbot knowledge from online discussion forums. In Proc. of IJCAI, 2007.

Digital Library

[8]

J. Jeon, W. B. Croft, and J. H. Lee. Finding similar questions in large question and answer archives. In CIKM, 2005.

Digital Library

[9]

V. Jijkoun and M. de Rijke. Retrieving answers from frequently asked questions pages on the web. In CIKM, 2005.

Digital Library

[10]

N. Jindal and B. Liu. Identifying comparative sentences in text documents. In SIGIR, 2006.

Digital Library

[11]

J. Ko, E. Nyberg, and L. Si. A probabilistic graphical model for joint answer ranking in question answering. In SIGIR, 2007.

Digital Library

[12]

O. Kurland and L. Lee. Pagerank without hyperlinks: structural re-ranking using links induced by language models. In SIGIR, 2005.

Digital Library

[13]

J. D. Lafferty and C. Zhai. Document language models, query models, and risk minimization for information retrieval. In SIGIR, 2001.

Digital Library

[14]

W. G. Lehnert. The process of question answering: A computer simulation of cognition. Lawrence Erlbaum Associates, 1978.

[15]

J. Otterbacher, G. Erkan, and D. R. Radev. Using random walks for question-focused sentence retrieval. In HLT/EMNLP, 2005.

Digital Library

[16]

J. Pei, J. Han, B. Mortazavi-Asl, and H. Pinto. Prefixspan: Mining sequential patterns efficiently by prefix-projected pattern growth. In Proc. ICDE, 2001.

Digital Library

[17]

S. Riezler, A. Vasserman, I. Tsochantaridis, V. Mittal, and Y. Liu. Statistical machine translation for query expansion in answer retrieval. In ACL, 2007.

[18]

L. Shrestha and K. McKeown. Detection of question-answer pairs in email conversations. In Proc. of COLING, 2004.

Digital Library

[19]

G. Sun, G. Cong, X. Liu, C.-Y. Lin, and M. Zhou. Mining sequential patterns and tree patterns to detect erroneous sentences. In AAAI, 2007.

Digital Library

[20]

E. M. Voorhees and D. M. Tice. The trec-8 question answering track evaluation. In TREC, 1999.

[21]

K. Zechner. Automatic generation of concise summaries of spoken dialogues in unrestricted domains. In SIGIR, 2001.

Digital Library

[22]

D. Zhang and W. S. Lee. A language modeling approach to passage question answering. In Proc. of TREC, 2003.

[23]

L. Zhou and E. H. Hovy. Digesting virtual "geek" culture: The summarization of technical internet relay chats. In Proc. of ACL, 2005.

Digital Library

Cited By

Hadfi RIto T(2024)Structural complexity predicts consensus readability in online discussionsSocial Network Analysis and Mining10.1007/s13278-024-01212-114:1Online publication date: 4-Mar-2024
https://doi.org/10.1007/s13278-024-01212-1
Ojokoh BIgbe TAfolabi BDaramola O(2023)A graph model with integrated pattern and query-based technique for extracting answer to questions in community question answering systemSocial Network Analysis and Mining10.1007/s13278-023-01046-313:1Online publication date: 5-Mar-2023
https://doi.org/10.1007/s13278-023-01046-3
Li SZhou WWu Y(2023)A Chinese Dialogue Corpus Annotated with Dialogue ActChinese Language Resources10.1007/978-3-031-38913-9_14(227-245)Online publication date: 19-Dec-2023
https://doi.org/10.1007/978-3-031-38913-9_14
Show More Cited By

Index Terms

Finding question-answer pairs from online forums
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Extracting Chinese question-answer pairs from online forums
SMC'09: Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics

Extracting question-answer pairs from online forums is a meaningful work due to the huge amount of valuable user generated resource contained in forums. In this paper we consider the problem of extracting Chinese question-answer pairs for the first ...
Quality-aware collaborative question answering: methods and evaluation
WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data Mining

Community Question Answering (QA) portals contain questions and answers contributed by hundreds of millions of users. These databases of questions and answers are of great value if they can be used directly to answer questions from any user. In this ...
Combining evidence with a probabilistic framework for answer ranking and answer merging in question answering

Question answering (QA) aims at finding exact answers to a user's question from a large collection of documents. Most QA systems combine information retrieval with extraction techniques to identify a set of likely candidates and then utilize some ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval

July 2008

934 pages

ISBN:9781605581644

DOI:10.1145/1390334

General Chairs:
Tat-Seng Chua
National University of Singapore
,
Mun-Kew Leong
National Library Board, Singapore
,
Program Chairs:
Syung Hyon Myaeng
Information and Communications University, Korea
,
Douglas W. Oard
University of Maryland, College Park, USA
,
Fabrizio Sebastiani
Consiglio Nazionale delle Ricerche, Italy

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGIR '08

Sponsor:

SIGIR '08: The 31st Annual International ACM SIGIR Conference

July 20 - 24, 2008

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

138
Total Citations
View Citations
2,257
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)5

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hadfi RIto T(2024)Structural complexity predicts consensus readability in online discussionsSocial Network Analysis and Mining10.1007/s13278-024-01212-114:1Online publication date: 4-Mar-2024
https://doi.org/10.1007/s13278-024-01212-1
Ojokoh BIgbe TAfolabi BDaramola O(2023)A graph model with integrated pattern and query-based technique for extracting answer to questions in community question answering systemSocial Network Analysis and Mining10.1007/s13278-023-01046-313:1Online publication date: 5-Mar-2023
https://doi.org/10.1007/s13278-023-01046-3
Li SZhou WWu Y(2023)A Chinese Dialogue Corpus Annotated with Dialogue ActChinese Language Resources10.1007/978-3-031-38913-9_14(227-245)Online publication date: 19-Dec-2023
https://doi.org/10.1007/978-3-031-38913-9_14
Lo STan KOuh E(2021)Automated doubt identification from informal reflections through hybrid sentic patterns and machine learning approachResearch and Practice in Technology Enhanced Learning10.1186/s41039-021-00149-916:1Online publication date: 8-Feb-2021
https://doi.org/10.1186/s41039-021-00149-9
Khan AGul MAlharbi AUddin MAli SAlouffi B(2021)Impact of Lexical Features on Answer Detection Model in Discussion ForumsComplexity10.1155/2021/28932572021(1-8)Online publication date: 14-Apr-2021
https://doi.org/10.1155/2021/2893257
Yan RLiao WZhao DWen J(2021)Multi-Response Awareness for Retrieval-Based Conversations: Respond with Diversity via Dynamic Representation LearningACM Transactions on Information Systems10.1145/347045039:4(1-29)Online publication date: 20-Sep-2021
https://dl.acm.org/doi/10.1145/3470450
Rashid MJamour FHristidis VDemartini GZuccon GCulpepper JHuang ZTong H(2021)QuAXProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482289(1518-1527)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3459637.3482289
Chatterjee PDamevski KKraft NPollock L(2021)Automatically Identifying the Quality of Developer Chats for Post Hoc UseACM Transactions on Software Engineering and Methodology10.1145/345050330:4(1-28)Online publication date: 23-Jul-2021
https://dl.acm.org/doi/10.1145/3450503
Liu HLi ELiu XSu KZhang S(2021)Anomaly Detection With Kernel Preserving EmbeddingACM Transactions on Knowledge Discovery from Data10.1145/344768415:5(1-18)Online publication date: 10-May-2021
https://dl.acm.org/doi/10.1145/3447684
Peng HLi JSong YYang RRanjan RYu PHe L(2021)Streaming Social Event Detection and Evolution Discovery in Heterogeneous Information NetworksACM Transactions on Knowledge Discovery from Data10.1145/344758515:5(1-33)Online publication date: 10-May-2021
https://dl.acm.org/doi/10.1145/3447585
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents