Sentence-level instance-weighting for graph-based and transition-based dependency parsing
Abstract
Instance-weighting has been shown to be effective in statistical machine translation (Foster et al., 2010), as well as cross-language adaptation of dependency parsers (Søgaard, 2011). This paper presents new methods to do instance-weighting in state-of-the-art dependency parsers. The methods are evaluated on Danish and English data with consistent improvements over unadapted baselines.
References
[1]
Shai Ben-David, John Blitzer, Koby Crammer, and Fernando Pereira. 2007. Analysis of representations for domain adaptation. Advances in Neural Information Processing Systems, 19:137--144.
[2]
Steffen Bickel and Tobias Scheffer. 2007. Dirichletenhanced spam filtering based on biased samples. Advances in Neural Information Processing Systems, 19:161--168.
[3]
John Blitzer, Mark Dredze, and Fernando Pereira. 2007. Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In ACL.
[4]
Matthias Buch-Kromann. 2003. The Danish Dependency Treebank and the DTAG Treebank Tool. In TLT.
[5]
Sabine Buchholz and Erwin Marsi. 2006. CoNLL-X shared task on multilingual dependency parsing. In CoNLL.
[6]
Bo Chen, Wai Lam, Ivor Tsang, and Tak-Lam Wong. 2009. Extracting discriminative concepts for domain adaptation in text mining. In KDD.
[7]
Koby Crammer and Yoram Singer. 2003. Ultraconservative algorithms for multiclass problems. In JMLR.
[8]
Hal Daume III. 2007. Frustratingly easy domain adaptation. In ACL.
[9]
Mark Dredze, John Blitzer, Partha Pratim Talukdar, Kuzman Ganchev, João Graca, and Fernando Pereira. 2007. Frustratingly hard domain adaptation for dependency parsing. In EMNLP-CoNLL.
[10]
Jason Eisner. 1996. Three new probabilistic models for dependency parsing. In COLING.
[11]
George Foster, Cyril Goutte, and Roland Kuhn. 2010. Discriminative instance weighting for domain adaptation in statistical machine translation. In EMNLP.
[12]
Daisuke Kawahara and Kiyotaka Uchimoto. 2009. Learning reliability of parses for domain adaptation of dependency parsing. In IJCNLP.
[13]
Philipp Koehn. 2005. Europarl: a parallel corpus for statistical machine translation. In MT-Summit.
[14]
Mitchell Marcus, Mary Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313--330.
[15]
David McClosky, Eugene Charniak, and Mark Johnson. 2010. Automatic domain adaptation for parsing. In NAACL-HLT.
[16]
Ryan McDonald, Fernando Pereira, Kiril Ribarov, and Jan Hajič. 2005. Non-projective dependency parsing using spanning tree algorithms. In HLT-EMNLP.
[17]
Joakim Nivre, Johan Hall, Sandra Kübler, Ryan McDonald, Jens Nilsson, Sebastian Riedel, and Deniz Yuret. 2007a. The CoNLL 2007 shared task on dependency parsing. In EMNLP-CoNLL.
[18]
Joakim Nivre, Johan Hall, Jens Nilsson, Atanas Chanev, Gülsen Eryigit, Sandra Kübler, Svetoslav Marinov, and ErwinMarsi. 2007b. MaltParser: a language-independent system for data-driven dependency parsing. Natural Language Engineering, 13(2):95--135.
[19]
Barbara Plank and Gertjan van Noord. 2011. Effective measures of domain similarity for parsing. In ACL.
[20]
Kenji Sagae and Jun'ichi Tsujii. 2007. Dependency parsing and domain adaptation with lr models and parser ensembles. In EMNLP-CoNLL.
[21]
Hidetoshi Shimodaira. 2000. Improving predictive inference under covariate shift by weighting the log-likelihood function. Journal of Statistical Planning and Inference, 90:227--244.
[22]
Anders Søgaard. 2011. Data point selection for crosslanguage adaptation of dependency parsers. In ACL.
[23]
Bonnie Webber. 2009. Genre distinctions for discourse in the Penn Treebank. In ACL-IJCNLP.
[24]
Bianca Zadrozny. 2004. Learning and evaluating classifiers under sample selection bias. In ICML.
[25]
Jingbo Zhu and Eduard Hovy. 2007. Active learning for word sense disambiguation with methods for addressing the class imbalance problem. In EMNLP-CoNLL.
Recommendations
Transition-Based Dependency Parsing Exploiting Supertags
Lexical information, including surface word form and part-of-speech POS information, plays a crucial role when predicting ambiguous dependency relationships in dependency parsing. However, for resolving dependency ambiguities, surface word information ...
Improve Chinese Semantic Dependency Parsing via Syntactic Dependency Parsing
IALP '12: Proceedings of the 2012 International Conference on Asian Language ProcessingWe address the problem of Chinese semantic dependency parsing. Dependency parsing is traditionally oriented to syntax analysis, which we denote by syntactic dependency parsing to distinguish it from semantic dependency parsing. In this paper, firstly we ...
Improving Transition-Based Dependency Parsing of Hindi and Urdu by Modeling Syntactically Relevant Phenomena
In recent years, transition-based parsers have shown promise in terms of efficiency and accuracy. Though these parsers have been extensively explored for multiple Indian languages, there is still considerable scope for improvement by properly ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Publisher
Association for Computational Linguistics
United States
Publication History
Published: 05 October 2011
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 80Total Downloads
- Downloads (Last 12 months)14
- Downloads (Last 6 weeks)0
Reflects downloads up to 12 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in