Abstract
In this paper, we describe our experimentations in evaluating answer formulation for question-answering (QA) systems. In the context of QA, answer formulation can serve two purposes: improving answer extraction or improving human-computer interaction (HCI). Each purpose has di.erent precision/recall requirements. We present our experiments for both purposes and argue that formulations of better grammatical quality are beneficial for both answer extraction and HCI.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
E. Agichtein and L. Gravano. Snowball: Extracting relations from large plain-text collections. In Proceedings of the 5th ACM International Conference on Digital Libraries, 2000.
E. Brill, S. Dumais, and M. Banko. An Analysis of the AskMSR Question-Answering System. In Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP-2002), Philadelphia, 2002.
E. Brill, J. Lin, M. Banko, S. Dumais, and A. Ng. Data-Intensive Question Answering.In Proceedings of The Tenth Text Retrieval Conference (TREC-X), pages 393–400, Gaithersburg, Maryland, 2001.
J. Burger, C. Cardie, V. Chaudhri, R. Gaizauskas, S. Harabagiu, D. Israel, C. Jacquemin, C-Y Lin, S. Maiorano, G. Miller, D. Moldovan, B. Ogden, J. Prager, E. Rilo., A. Singhal, R. Shrihari, T. Strzalkowski, E. Voorhees, and R. eischedel. Issues, Tasks and Program Structures to Roadmap Research in Question & Answering (Q&A). Technical report, 2001. http://www-nlpir.nist.gov/projects/duc/roadmapping.html.
C.L.A. Clarke, G.V. Cormack, T.R Lynam, C.M. Li, and G.L. McLearn. Web Reinforced Question Answering (MultiText Experiments for TREC 2001). In Proceedings of The Tenth Text Retrieval Conference (TREC-X), pages 673–679, Gaithersburg, Maryland, 2001.
S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea, M. Surdeanu, R. Bunescu, R. Girju, V. Rus, and P. Morarescu. The role of lexico-semantic feedbacks in open-domain textual question answering. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (ACL-2001), pages 274–281,Toulouse, France, July 2001.
E. Hovy, U. Hermjakob, and C.-Y. Lin. The Use of External Knowledge in Factoid QA. In Proceedings of The Tenth Text REtrieval Conference (TREC-X), pages 166–174, Gaithersburg, Maryland, 2001.
S. Lawrence and C. L. Giles. Context and page analysis for improved web search. IEEE Internet Computing, 2(4):38–46, 1998.
T. Lynam, C. Clarke, and G. Cormack.Information extraction with term frequencies. In Proceedings of HLT 2001-First International Conference on Human Language Technology Research, pages 169–172, San Diego, California, March 2001.
L. Plamondon and L. Kosseim. Quantum: A function-based question answering system. In R. Cohen and B. Spencer, editors, Proceedings of The Fifteenth Canadian Conference on Artificial Intelligence (AI’ 2002) — Lecture Notes in Artificial Intelligence No. 2338, pages 281–292, Calgary, May 2002.
E. Reiter and R. Dale. Building Natural Language Generation Systems. Cambridge University Press, 2000.
E.M. Voorhees and D.K. Harman, editors. Proceedings of The Eight Text Retrieval Conference (TREC-8), Gaithersburg, Maryland, November 1999. NIST. available at http://trec.nist.gov/pubs/trec8/t8_proceedings.html.
E. M. Voorhees and D.K. Harman, editors. Proceedings of The Ninth Text Retrieval Conference (TREC-9), Gaithersburg, Maryland, 2000. NIST. available at http://trec.nist.gov/pubs/trec9/t9_proceedings.html
E. M. Voorhees and D.K. Harman, editors. Proceedings of The Tenth Text REtrievalConference (TREC-X), Gaithersburg, Maryland, November 2001. NIST. available at http://trec.nist.gov/pubs/trec10/t10_proceedings.html.
E. M. Voorhees and D.K. Harman, editors. Proceedings of The Eleventh Text Retrieval Conference (TREC-11), Gaithersburg, Maryland, November 2002. NIST. to appear.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kosseim, L., Plamondon, L., Guillemette, L.J. (2003). Answer Formulation for Question-Answering. In: Xiang, Y., Chaib-draa, B. (eds) Advances in Artificial Intelligence. Canadian AI 2003. Lecture Notes in Computer Science, vol 2671. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44886-1_5
Download citation
DOI: https://doi.org/10.1007/3-540-44886-1_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40300-5
Online ISBN: 978-3-540-44886-0
eBook Packages: Springer Book Archive