Article

Filtering or adapting: two strategies to exploit noisy parallel corpora for cross-language information retrieval

Authors:

Lixin Shi,

Jian-Yun NieAuthors Info & Claims

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

Pages 814 - 815

https://doi.org/10.1145/1183614.1183744

Published: 06 November 2006 Publication History

Get Access

Abstract

Noisy parallel corpora have been widely used for Cross-language information retrieval (CLIR). However, the previous studies only focus on truly parallel corpus. In this paper, we examine two possible approaches to exploit noisy corpora: filtering out noise from the corpora or adapting the training process of translation model to the noise corpora. Our experiments show that the second approach is better suited to CLIR.

References

[1]

Brown, P. F., S. A. Della Pietra, V. J. Della Pietra, and R. L. Mercer. The Mathematics of Statistical Machine Translation: Parameter Estimation. Comp. Ling. 19(2):263--311, 1993.

Digital Library

Google Scholar

[2]

Gale, W. A. and K. W. Church. A Program for Aligning Sentences in Bilingual Corpora. Comp. Ling. 19(1): 75--102, 1993.

Digital Library

Google Scholar

[3]

Khadivi, S. and H. Ney. Automatic Filtering of Bilingual Corpora for Statistical Machine Translation. NLDB, pp. 263--274, 2005.

Digital Library

Google Scholar

[4]

Kraaij, W., J. Y. Nie, and M. Simard. Embedding Web-Based Statistical Translation Models in Cross-Language Information Retrieval. Comp. Ling. 29(3): 381--419, 2003

Digital Library

Google Scholar

[5]

Nie, J. Y. and J. Cai. Filtering noisy Parallel Corpora of Web Pages. IEEE symp. on NLPKE, pp.453--458, 2001.

Google Scholar

[6]

Nie, J. Y., M. Simard, P. Isabelle, and R. Durand. Cross-language information retrieval based on parallel texts and automatic mining of parallel texts from the Web. SIGIR, pp.74--81, 1999.

Digital Library

Google Scholar

[7]

Resnik, P. Mining the Web for Bilingual Text. ACL, pp.527--534, 1999.

Digital Library

Google Scholar

Cited By

View all

Shi LNie JBai JLi JLee WSilvestri F(2007)Comparing different units for query translation in Chinese cross-language information retrievalProceedings of the 2nd international conference on Scalable information systems10.5555/1366804.1366885(1-9)Online publication date: 6-Jun-2007
https://dl.acm.org/doi/10.5555/1366804.1366885

Index Terms

Filtering or adapting: two strategies to exploit noisy parallel corpora for cross-language information retrieval
1. Information systems
  1. Information retrieval

Recommendations

Development of Hindi-Punjabi parallel corpus using existing Hindi-Punjabi machine translation system
IITM '10: Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia

This paper describes the development of Hindi-Punjabi sentence aligned parallel corpus consisting of 50K sentences using existing Hindi-Punjabi Machine Translation (MT) system (available at http://h2p.learnpunjabi.org). This parallel corpus is utmost ...
Exploring the sawa corpus: collection and deployment of a parallel corpus English--Swahili

Research in machine translation and corpus annotation has greatly benefited from the increasing availability of word-aligned parallel corpora. This paper presents ongoing research on the development and application of the sawa corpus, a two-million-word ...
Semantic morphological variant selection and translation disambiguation for cross-lingual information retrieval
Abstract
Cross-Lingual Information Retrieval (CLIR) enables a user to query in a language which is different from the target documents language. CLIR incorporates a translation technique based on either a manual dictionary or a probabilistic dictionary ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

November 2006

916 pages

ISBN:1595934332

DOI:10.1145/1183614

General Chair:
Philip S. Yu
IBM T.J. Watson Research Center (USA)
,
Program Chairs:
Vassilis Tsotras
University of California-Riverside (USA)
,
Edward Fox
Virginia Tech (USA)
,
Bing Liu
University of Illinois at Chicago (USA)

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM06

Sponsor:

CIKM06: Conference on Information and Knowledge Management

November 6 - 11, 2006

Virginia, Arlington, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
256
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shi LNie JBai JLi JLee WSilvestri F(2007)Comparing different units for query translation in Chinese cross-language information retrievalProceedings of the 2nd international conference on Scalable information systems10.5555/1366804.1366885(1-9)Online publication date: 6-Jun-2007
https://dl.acm.org/doi/10.5555/1366804.1366885

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Development of Hindi-Punjabi parallel corpus using existing Hindi-Punjabi machine translation system

Exploring the sawa corpus: collection and deployment of a parallel corpus English--Swahili

Semantic morphological variant selection and translation disambiguation for cross-lingual information retrieval