research-article

Free access

Tree linearization in English: improving language model based approaches

Authors:

NAACL-Short '09: Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers

Pages 225 - 228

Published: 31 May 2009 Publication History

PDF eReader

Abstract

We compare two approaches to dependency tree linearization, a task which arises in many NLP applications. The first one is the widely used 'overgenerate and rank' approach which relies exclusively on a trigram language model (LM); the second one combines language modeling with a maximum entropy classifier trained on a range of linguistic features. The results provide strong support for the combined method and show that trigram LMs are appropriate for phrase linearization while on the clause level a richer representation is necessary to achieve comparable performance.

References

[1]

Clarkson, P.&R. Rosenfeld (1997). Statistical language modeling using the CMU-Cambridge toolkit. In Proc. of EUROSPEECH-97, pp. 2707--2710.

Google Scholar

[2]

Filippova, K.&M. Strube (2007). Generating constituent order in German clauses. In Proc. of ACL-07, pp. 320--327.

Google Scholar

[3]

Goodman, J. T. (2001). A bit of progress in language modeling. Computer Speech and Language, pp. 403--434.

Digital Library

Google Scholar

[4]

Jurafsky, D.&J. H. Martin (2008). Speech and Language Processing. Upper Saddle River, N.J.: Prentice Hall.

Digital Library

Google Scholar

[5]

Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30:81--93.

Google Scholar

[6]

Klein, D.&C. D. Manning (2003). Accurate unlexicalized parsing. In Proc. of ACL-03, pp. 423--430.

Digital Library

Google Scholar

[7]

Langkilde, I.&K. Knight (1998). Generation that exploits corpus-based statistical knowledge. In Proc. of COLING-ACL-98, pp. 704--710.

Digital Library

Google Scholar

[8]

Lapata, M. (2006). Automatic evaluation of information ordering: Kendall's tau. Computational Linguistics, 32(4):471--484.

Digital Library

Google Scholar

[9]

Marsi, E.&E. Krahmer (2005). Explorations in sentence fusion. In Proc. of ENLG-05, pp. 109--117.

Google Scholar

[10]

Ringger, E., M. Gamon, R. C. Moore, D. Rojas, M. Smets&S. Corston-Oliver (2004). Linguistically informed statistical models of constituent structure for ordering in sentence realization. In Proc. of COLING-04, pp. 673--679.

Digital Library

Google Scholar

[11]

Uchimoto, K., M. Murata, Q. Ma, S. Sekine&H. Isahara (2000). Word order acquisition from corpora. In Proc. of COLING-00, pp. 871--877.

Digital Library

Google Scholar

Cited By

View all

Banerjee SMitra PSugiyama KVanoirbeek CGenevès P(2015)Generating Abstractive Summaries from Meeting TranscriptsProceedings of the 2015 ACM Symposium on Document Engineering10.1145/2682571.2797061(51-60)Online publication date: 8-Sep-2015
https://dl.acm.org/doi/10.1145/2682571.2797061
Bohnet BBjörkelund AKuhn JSeeker WZarrieß STsujii JHenderson JPasca M(2012)Generating non-projective word order in statistical linearizationProceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning10.5555/2390948.2391049(928-939)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2390948.2391049
White MRajkumar RTsujii JHenderson JPasca M(2012)Minimal dependency length in realization rankingProceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning10.5555/2390948.2390979(244-255)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2390948.2390979
Show More Cited By

Index Terms

Tree linearization in English: improving language model based approaches
1. Computing methodologies

Recommendations

Using decision tree to hybrid morphology generation of Persian verb for English-Persian translation

HighlightsAnalyzing the output of English to Persian machine translation systems.Presenting hybrid morphology generation using a parallel corpus.Using a set of linguistically motivated features.Making a model to predict six morphological features of the ...
POS-tagger for English-Vietnamese bilingual corpus
HLT-NAACL-PARALLEL '03: Proceedings of the HLT-NAACL 2003 Workshop on Building and using parallel texts: data driven machine translation and beyond - Volume 3

Corpus-based Natural Language Processing (NLP) tasks for such popular languages as English, French, etc. have been well studied with satisfactory achievements. In contrast, corpus-based NLP tasks for unpopular languages (e.g. Vietnamese) are at a ...
Websters Occitan - English Thesaurus Dictionary

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

NAACL-Short '09: Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers

May 2009

317 pages

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 31 May 2009

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 21 of 29 submissions, 72%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
315
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)8

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Banerjee SMitra PSugiyama KVanoirbeek CGenevès P(2015)Generating Abstractive Summaries from Meeting TranscriptsProceedings of the 2015 ACM Symposium on Document Engineering10.1145/2682571.2797061(51-60)Online publication date: 8-Sep-2015
https://dl.acm.org/doi/10.1145/2682571.2797061
Bohnet BBjörkelund AKuhn JSeeker WZarrieß STsujii JHenderson JPasca M(2012)Generating non-projective word order in statistical linearizationProceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning10.5555/2390948.2391049(928-939)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2390948.2391049
White MRajkumar RTsujii JHenderson JPasca M(2012)Minimal dependency length in realization rankingProceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning10.5555/2390948.2390979(244-255)Online publication date: 12-Jul-2012
https://dl.acm.org/doi/10.5555/2390948.2390979
Zarrieß SKuhn JCahill ADaelemans W(2012)To what extent does sentence-internal realisation reflect discourse context?Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics10.5555/2380816.2380910(767-776)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2380816.2380910
Zhang YBlackwood GClark SDaelemans W(2012)Syntax-based word ordering incorporating a large-scale language modelProceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics10.5555/2380816.2380906(736-746)Online publication date: 23-Apr-2012
https://dl.acm.org/doi/10.5555/2380816.2380906
Elsner MSanthanam DFilippova KWan S(2011)Learning to fuse disparate sentencesProceedings of the Workshop on Monolingual Text-To-Text Generation10.5555/2107679.2107686(54-63)Online publication date: 24-Jun-2011
https://dl.acm.org/doi/10.5555/2107679.2107686
Thadani KMcKeown KFilippova KWan S(2011)Towards strict sentence intersectionProceedings of the Workshop on Monolingual Text-To-Text Generation10.5555/2107679.2107685(43-53)Online publication date: 24-Jun-2011
https://dl.acm.org/doi/10.5555/2107679.2107685
Zarrieß SCahill AKuhn JLin D(2011)Underspecifying and predicting voice for surface realisation rankingProceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 110.5555/2002472.2002599(1007-1017)Online publication date: 19-Jun-2011
https://dl.acm.org/doi/10.5555/2002472.2002599
Marsi EKrahmer EHendrickx IDaelemans W(2010)On the limits of sentence compression by deletionEmpirical methods in natural language generation10.5555/1880370.1880374(45-66)Online publication date: 1-Jan-2010
https://dl.acm.org/doi/10.5555/1880370.1880374
Bohnet BWanner LMille SBurga AJoshi AHuang CJurafsky D(2010)Broad coverage multilingual deep sentence generation with a stochastic multi-level realizerProceedings of the 23rd International Conference on Computational Linguistics10.5555/1873781.1873793(98-106)Online publication date: 23-Aug-2010
https://dl.acm.org/doi/10.5555/1873781.1873793
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Using decision tree to hybrid morphology generation of Persian verb for English-Persian translation

POS-tagger for English-Vietnamese bilingual corpus

Websters Occitan - English Thesaurus Dictionary

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Login options

Full Access

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations