More Web Proxy on the site http://driver.im/

research-article

Semantic verification in an online fact seeking environment

Authors:

Dmitri Roussinov,

Ozgur TuretkenAuthors Info & Claims

CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

Pages 71 - 78

https://doi.org/10.1145/1321440.1321453

Published: 06 November 2007 Publication History

Abstract

Many artificial intelligence tasks, such as automated question answering, reasoning or heterogeneous database integration, involve verification of a semantic category (e.g. "coffee" is a drink, "red" is a color, while "steak" is not a drink and "big" is not a color). We present a novel algorithm to automatically validate a semantic category. Contrary to the methods suggested earlier, our approach does not rely on any manually codified knowledge but instead capitalizes on the diversity of topics and word usage on the World Wide Web. We have tested our approach within our online fact-seeking (question answering) environment. When tested on the TREC questions that expect the answer to belong to a specific semantic category, our approach has improved the accuracy by up to 14% depending on the model and metrics used.

References

[1]

Agichtein, E., Lawrence, S., and Gravano, L. (2001). Learning Search Engine Specific Query Transformations for Question Answering. 10th WWW Conference. Hong Kong, China, May 1-5.

Digital Library

[2]

Boris Katz, Jimmy Lin, Daniel Loreto, Wesley Hildebrandt, Matthew Bilotti, Sue Felshin, Aaron Fernandes, Gregory Marton, and Federico Mora. Integrating Web-based and Corpus-based Techniques for Question Answering. (2003). Proceedings of the Twelfth Text REtrieval Conference (TREC 2003), November 2003, Gaithersburg, Maryland.

[3]

Brill, E. (1995). Transformation-based error-driven learning and natural language processing: A case study in part of speech tagging. Computational Linguistics, 21(4):543--566.

Digital Library

[4]

Brill, E., Dumais, S. and Banko, M., An Analysis of the AskMSR Question-Answering System, Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, Philadelphia, PA, USA, July 6-7.

Digital Library

[5]

Downey, Oren Etzioni, and Stephen Soderland (2005). A Probabilistic Model of Redundancy in Information Extraction. IJCAI-05.

Digital Library

[6]

Dumais, S., Banko, M., Brill, E., Lin, J., and Ng, A. (2002). Web Question Answering: Is More Always Better? Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, Tampere, Finland, August 11-15.

Digital Library

[7]

E. Agirre, O. Ansa, E. Hovy, and D. Martinez. Enriching very large ontologies using the WWW. In Proceedings of the ECAI Ontology Learning Workshop, 2000.

[8]

E. Charniak and M. Berland. Finding parts in very large corpora. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics (ACL), pages 57--64, 1999.

Digital Library

[9]

Etzioni, O., Cafarella, M., Downey, D., Popescu, A.-M., Shaked, T., Soderland, S., Weld, D., and Yates, A. (2005). Unsupervised Named-Entity Extraction from the Web: An Experimental Study. 2005. Artificial Intelligence.

Digital Library

[10]

Harabagiu, S., Moldovan, D., Pasca, M., Mihalcea, R., Surdeanu, M., Bunescu, R., Girju, R., Rus, V., and Morarescu, P. (2000). Falcon: Boosting knowledge for answer engines. In NIST Special Publication 500-249: The Ninth Text REtrieval Conference (TREC 9), pages 479--488, Gaithersburg, Maryland, November 13-16.

[11]

K. Ahmad, M. Tariq, B. Vrusias, and C. Handy. Corpus-based thesaurus construction for image retrieval in specialist domains. In Proceedings of the 25th European Conference on Advances in Information Retrieval (ECIR), pages 502--510, 2003.

Digital Library

[12]

K. Markert, N. Modjeska, and M. Nissim. Using the web for nominal anaphora resolution. In EACL Workshop on the Computational Treatment of Anaphora, 2003.

[13]

Katz, B. (1997). From Sentence Processing to Information Access on the World Wide Web. In Natural Language Processing for the World Wide Web: Papers from the 1997 AAAI Spring Symposium, pages 77--94, 1997.

[14]

Kwok, Cody and Etzioni, Oren and Weld, Daniel S. (2001) Scaling Question Answering to the Web. In Proceedings International WWW Conference(10), Hong-Kong.

Digital Library

[15]

Lin, J. (2005). Evaluation of Resources for Question Answering Evaluation. Proceedings of ACM Conference on Research and development in information retrieval, 2005.

Digital Library

[16]

M. Poesio, T. Ishikawa, S. Schulte im Walde, and R. Viera. Acquiring lexical knowledge for anaphora resolution. In Proceedings of the 3rd Conference on Language Resources and Evaluation (LREC), 2002.

[17]

M. A. Hearst, 'Automatic acquisition of hyponyms from large text corpora', in Proceedings of the 14th International Conference on Computational Linguistics, (1992).

Digital Library

[18]

P. Cimiano, G. Ladwig, and S. Staab. Gimme' the context: Context-driven automatic semantic annotation with C-PANKOW. In Proceedings of the 14th World Wide Web Conference, 2005.

Digital Library

[19]

P. Cimiano, S. Handschuh, and S. Staab. Towards the self-annotating web. In Proceedings of the 13th World Wide Web Conference, pages 462--471, 2004.

Digital Library

[20]

R. Girju and M. Moldovan. Text mining for causal relations. In Proceedings of the FLAIRS Conference, pages 360--364, 2002.

Digital Library

[21]

Radev, D. R., Qi, H., Zheng, Z., Blair-Goldensohn, S., Zhang, Z., Fan, W., and Prager, J. (2001). Mining the web for answers to natural language questions. In the Proceedings of ACM CIKM 2001: Tenth International Conference on Information and Knowledge Management, Atlanta, GA, November 5-10.

Digital Library

[22]

Radev, D., Fan, W., Qi, H., Wu, H., and Grewal, A., (2005). Probabilistic question answering on the web, Journal of the American Society for Information Science and Technology, 56(3).

Digital Library

[23]

Ravichandran, D., and Hovy, E. (2002). Learning surface text patterns for a question answering system. In Proceedings of ACL, 2002.

Digital Library

[24]

Roussinov, D., Chau., M., Filatova, E., Robles, J., Building on Redundancy: Factoid Question Answering, Robust Retrieval and the "Other". In proceedings of TREC 2005, Nov. 15-18, 2005.

[25]

Schlobach, S., Olsthoorn, M., and de Rijke, M. (2004). Type Checking in Open-Domain Question Answering (Extended Abstract), In: R. Verbrugge, N. Taatgen, and L. Schomaker, editors, Proceedings BNAIC 2004, pages 367--368, 2004.

[26]

Soubbotin, M. and Soubbotin, S. (2002). Use of patterns for detection of likely answer strings: A systematic approach. Proceedings of the Eleventh Text Retrieval Conference TREC 2002. Gaithersburg, Maryland, November 19-22.

[27]

Voorhees, E. and Buckland, L. P., Eds. (2004). Proceedings of the Eleventh Text Retrieval Conference TREC 2004. Gaithersburg, Maryland, November 16-19.

Cited By

Roussinov DSharoff SPuchnina N(2023)Fine-tuning language models to recognize semantic relationsLanguage Resources and Evaluation10.1007/s10579-023-09677-w57:4(1463-1486)Online publication date: 23-Jul-2023
https://doi.org/10.1007/s10579-023-09677-w
Roussinov DPuchnina N(2019)Combining Neural Networks and Pattern Matching for Ontology Mining - a Meta Learning Inspired Approach2019 IEEE 13th International Conference on Semantic Computing (ICSC)10.1109/ICOSC.2019.8665528(63-70)Online publication date: Jan-2019
https://doi.org/10.1109/ICOSC.2019.8665528
Roussinov D(2011)Towards semantic category verification with arbitrary precisionProceedings of the Third international conference on Advances in information retrieval theory10.5555/2040317.2040351(274-284)Online publication date: 12-Sep-2011
https://dl.acm.org/doi/10.5555/2040317.2040351
Show More Cited By

Index Terms

Semantic verification in an online fact seeking environment
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

Cross ontology query answering on the semantic web: an initial evaluation
K-CAP '09: Proceedings of the fifth international conference on Knowledge capture

PowerAqua is a Question Answering system, which takes as input a natural language query and is able to return answers drawn from relevant semantic resources found anywhere on the Semantic Web. In this paper we provide two novel contributions: First, we ...
Semantic question answering system over linked data using relational patterns
EDBT '13: Proceedings of the Joint EDBT/ICDT 2013 Workshops

Question answering is the task of answering questions in natural language. Linked Data project and Semantic Web community made it possible for us to query structured knowledge bases like DBpedia and YAGO. Only expert users, however, with the knowledge ...
A Semantic Similarity-based Subgraph Matching Method for Improving Question Answering over RDF
WWW '20: Companion Proceedings of the Web Conference 2020

RDF question/answering (Q/A) system can explore RDF data by translating natural language questions into SPARQL queries. In this poster, we design a generation-and-ranking approach to translate natural language questions into SPARQL queries based on ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

November 2007

1048 pages

ISBN:9781595938039

DOI:10.1145/1321440

Co-chair:
Alberto H. F. Laender,
Conference Chairs:
André O. Falcão
Universidade de Lisboa, Portugal
,
Øystein Haug Olsen,
General Chair:
Mário J. Silva
(Universidade de Lisboa, Portugal)
,
Program Chairs:
Ricardo Baeza-Yates,
Deborah L. McGuinness,
Bjorn Olstad

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM07

Sponsor:

CIKM07: Conference on Information and Knowledge Management

November 6 - 10, 2007

Lisbon, Portugal

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
350
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)1

Reflects downloads up to 11 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Roussinov DSharoff SPuchnina N(2023)Fine-tuning language models to recognize semantic relationsLanguage Resources and Evaluation10.1007/s10579-023-09677-w57:4(1463-1486)Online publication date: 23-Jul-2023
https://doi.org/10.1007/s10579-023-09677-w
Roussinov DPuchnina N(2019)Combining Neural Networks and Pattern Matching for Ontology Mining - a Meta Learning Inspired Approach2019 IEEE 13th International Conference on Semantic Computing (ICSC)10.1109/ICOSC.2019.8665528(63-70)Online publication date: Jan-2019
https://doi.org/10.1109/ICOSC.2019.8665528
Roussinov D(2011)Towards semantic category verification with arbitrary precisionProceedings of the Third international conference on Advances in information retrieval theory10.5555/2040317.2040351(274-284)Online publication date: 12-Sep-2011
https://dl.acm.org/doi/10.5555/2040317.2040351
Roussinov D(2011)Towards Semantic Category Verification with Arbitrary PrecisionAdvances in Information Retrieval Theory10.1007/978-3-642-23318-0_25(274-284)Online publication date: 2011
https://doi.org/10.1007/978-3-642-23318-0_25

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents