Towards Neural Machine Translation with Partially Aligned Corpora

Yining Wang, Yang Zhao, Jiajun Zhang, Chengqing Zong, Zhengshan Xue


Abstract
While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in which there only exists monolingual corpora and phrase pairs. We propose a new method towards translation with partially aligned sentence pairs which are derived from the phrase pairs and monolingual corpora. To make full use of the partially aligned corpora, we adapt the conventional NMT training method in two aspects. On one hand, different generation strategies are designed for aligned and unaligned target words. On the other hand, a different objective function is designed to model the partially aligned parts. The experiments demonstrate that our method can achieve a relatively good result in such a translation scenario, and tiny bitexts can boost translation quality to a large extent.
Anthology ID:
I17-1039
Volume:
Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
November
Year:
2017
Address:
Taipei, Taiwan
Editors:
Greg Kondrak, Taro Watanabe
Venue:
IJCNLP
SIG:
Publisher:
Asian Federation of Natural Language Processing
Note:
Pages:
384–393
Language:
URL:
https://aclanthology.org/I17-1039
DOI:
Bibkey:
Cite (ACL):
Yining Wang, Yang Zhao, Jiajun Zhang, Chengqing Zong, and Zhengshan Xue. 2017. Towards Neural Machine Translation with Partially Aligned Corpora. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 384–393, Taipei, Taiwan. Asian Federation of Natural Language Processing.
Cite (Informal):
Towards Neural Machine Translation with Partially Aligned Corpora (Wang et al., IJCNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/I17-1039.pdf