Abstract
In order to improve the efficiency of human translation, there is an increasing interest in applying machine translation (MT) to computer assisted translation (CAT). The newly proposed CAT-oriented input method is such a typical approach, which can help translators significantly save keystrokes by exploiting MT deep information, such as n-best candidates, hypotheses and translation rules. In order to further save more keystrokes, we propose in this paper a novel MT evaluation metric for coordinating human translators with the input method. This evaluation metric takes MT deep information into account, and makes longer perfect fragments correspond to fewer keystrokes. Extensive experiments show that the novel evaluation metric makes MT substantially reduce the keystrokes of translating process by accurately grasping deep information for the CAT-oriented input method, and it significantly improves the productivity of human translation compared with BLEU and TER.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barrachina, S., Bender, O., Casacuberta, F., Cubel, J.C.E., Khadivi, S., Lagarda, A., Ney, H., Jesus Tomas, E.V., Vilar, J.: Statistical approaches to computer-assisted translation. Comput. Linguist. 35(1), 3–28 (2009)
Carl, M., Dragsted, B., Elming, J., Hardt, D., Jakobsen, A.L.: The process of post-editing: a pilot study. Copenhagen Stud. Lang. 41, 131–142 (2011)
Cui, W.: Evaluation of chinese character keyboards. IEEE Comput. 18(1), 54–59 (1985)
Foster, G.: Text prediction for translators. Université de Montréal (2002)
Garay-Vitoria, N., Abascal, J.: Text prediction systems: a survey. Univ. Access Inf. Soc. 4(3), 188–203 (2006)
Green, S., Wang, S.I., Chuang, J., Heer, J., Schuster, S., Manning, C.D.: Human effort and machine learnability in computer aided translation. In: Proceedings of the EMNLP 2014 (2014)
Huang, G., Zhang, J., Zhou, Y., Zong, C.: A new input method for human translators: integrating machine translation effectively and imperceptibly. In: Proceedings of the IJCAI 2015 (2015)
Koehn, P.: Statistical significance tests for machine translation evaluation. In: Proceedings of the EMNLP 2004 (2004)
Koehn, P.: A process study of computer-aided transltion. Mach. Transl. J. 23(4), 241–263 (2009)
Koehn, P.: Computer-aided translation. Machine Translation Marathon (2012)
Och, F.J., Zens, R., Ney, H.: Efficient search for interactive statistical machine translation. In: Proceedings of EACL 2003 (2003)
Papineni, K., Roukos, S., Ward, T., Zhu, W.: Bleu: a method for automatic evaluation of machine translation. In: Proceedings of the ACL 2002 (2002)
Snover, M., JDorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Conference of the Association for Machine Translation in the Americas (2006)
Xiong, D., Liu, Q., Lin, S.: Maximum entropy based phrase reordering model for statistical machine translation. In: Proceedings of COLING-ACL 2006 (2006)
Zaidan, O.F.: Z-mert: a fully configurable open source tool for minimum error rate training of machine translation systems. Prague Bull. Math. Linguist. 91, 79–88 (2009)
Zhechev, V.: Machine translation infrastructure and post-ediing performance at autodesk. In: AMTA 2012 Workshop on Post-Editing Technology and Practice (2012)
Acknowledgments
The research work has been partially funded by the Natural Science Foundation of China (NSFC) under Grant No. 61403379 and No. 61402123.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, G., Zhao, C., Ma, H., Zhou, Y., Zhang, J. (2016). MinKSR: A Novel MT Evaluation Metric for Coordinating Human Translators with the CAT-Oriented Input Method. In: Yang, M., Liu, S. (eds) Machine Translation. CWMT 2016. Communications in Computer and Information Science, vol 668. Springer, Singapore. https://doi.org/10.1007/978-981-10-3635-4_1
Download citation
DOI: https://doi.org/10.1007/978-981-10-3635-4_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-3634-7
Online ISBN: 978-981-10-3635-4
eBook Packages: Computer ScienceComputer Science (R0)