[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content

MinKSR: A Novel MT Evaluation Metric for Coordinating Human Translators with the CAT-Oriented Input Method

  • Conference paper
  • First Online:
Machine Translation (CWMT 2016)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 668))

Included in the following conference series:

Abstract

In order to improve the efficiency of human translation, there is an increasing interest in applying machine translation (MT) to computer assisted translation (CAT). The newly proposed CAT-oriented input method is such a typical approach, which can help translators significantly save keystrokes by exploiting MT deep information, such as n-best candidates, hypotheses and translation rules. In order to further save more keystrokes, we propose in this paper a novel MT evaluation metric for coordinating human translators with the input method. This evaluation metric takes MT deep information into account, and makes longer perfect fragments correspond to fewer keystrokes. Extensive experiments show that the novel evaluation metric makes MT substantially reduce the keystrokes of translating process by accurately grasping deep information for the CAT-oriented input method, and it significantly improves the productivity of human translation compared with BLEU and TER.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 35.99
Price includes VAT (United Kingdom)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 44.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Barrachina, S., Bender, O., Casacuberta, F., Cubel, J.C.E., Khadivi, S., Lagarda, A., Ney, H., Jesus Tomas, E.V., Vilar, J.: Statistical approaches to computer-assisted translation. Comput. Linguist. 35(1), 3–28 (2009)

    Article  MathSciNet  Google Scholar 

  2. Carl, M., Dragsted, B., Elming, J., Hardt, D., Jakobsen, A.L.: The process of post-editing: a pilot study. Copenhagen Stud. Lang. 41, 131–142 (2011)

    Google Scholar 

  3. Cui, W.: Evaluation of chinese character keyboards. IEEE Comput. 18(1), 54–59 (1985)

    Article  Google Scholar 

  4. Foster, G.: Text prediction for translators. Université de Montréal (2002)

    Google Scholar 

  5. Garay-Vitoria, N., Abascal, J.: Text prediction systems: a survey. Univ. Access Inf. Soc. 4(3), 188–203 (2006)

    Article  Google Scholar 

  6. Green, S., Wang, S.I., Chuang, J., Heer, J., Schuster, S., Manning, C.D.: Human effort and machine learnability in computer aided translation. In: Proceedings of the EMNLP 2014 (2014)

    Google Scholar 

  7. Huang, G., Zhang, J., Zhou, Y., Zong, C.: A new input method for human translators: integrating machine translation effectively and imperceptibly. In: Proceedings of the IJCAI 2015 (2015)

    Google Scholar 

  8. Koehn, P.: Statistical significance tests for machine translation evaluation. In: Proceedings of the EMNLP 2004 (2004)

    Google Scholar 

  9. Koehn, P.: A process study of computer-aided transltion. Mach. Transl. J. 23(4), 241–263 (2009)

    Article  Google Scholar 

  10. Koehn, P.: Computer-aided translation. Machine Translation Marathon (2012)

    Google Scholar 

  11. Och, F.J., Zens, R., Ney, H.: Efficient search for interactive statistical machine translation. In: Proceedings of EACL 2003 (2003)

    Google Scholar 

  12. Papineni, K., Roukos, S., Ward, T., Zhu, W.: Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the ACL 2002 (2002)

    Google Scholar 

  13. Snover, M., JDorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Conference of the Association for Machine Translation in the Americas (2006)

    Google Scholar 

  14. Xiong, D., Liu, Q., Lin, S.: Maximum entropy based phrase reordering model for statistical machine translation. In: Proceedings of COLING-ACL 2006 (2006)

    Google Scholar 

  15. Zaidan, O.F.: Z-mert: a fully configurable open source tool for minimum error rate training of machine translation systems. Prague Bull. Math. Linguist. 91, 79–88 (2009)

    Article  Google Scholar 

  16. Zhechev, V.: Machine translation infrastructure and post-ediing performance at autodesk. In: AMTA 2012 Workshop on Post-Editing Technology and Practice (2012)

    Google Scholar 

Download references

Acknowledgments

The research work has been partially funded by the Natural Science Foundation of China (NSFC) under Grant No. 61403379 and No. 61402123.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guoping Huang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Huang, G., Zhao, C., Ma, H., Zhou, Y., Zhang, J. (2016). MinKSR: A Novel MT Evaluation Metric for Coordinating Human Translators with the CAT-Oriented Input Method. In: Yang, M., Liu, S. (eds) Machine Translation. CWMT 2016. Communications in Computer and Information Science, vol 668. Springer, Singapore. https://doi.org/10.1007/978-981-10-3635-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3635-4_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3634-7

  • Online ISBN: 978-981-10-3635-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics