0

Character-level Chinese-English Translation through ASCII Encoding

Character-level Neural Machine Translation is enabled for Chinese by breaking down characters into linguistic units using the Wubi encoding scheme, demonstrating promising results with both recurrent and convolutional models.

Year
2018
Venue
character-level-chinese-english-translation-1
Authors
4
Hosting
Abstract onlyARXIV-DEFAULT

Cite

Notes

Only stored in your browser.

Attribution

Abstract & full text
arxiv.org/abs/1805.03330v2ARXIV-DEFAULT
TL;DR
Semantic Scholar
Attribution policy →

Abstract

Character-level Neural Machine Translation (NMT) models have recently achieved impressive results on many language pairs. They mainly do well for Indo-European language pairs, where the languages share the same writing system. However, for translating between Chinese and English, the gap between the two different writing systems poses a major challenge because of a lack of systematic correspondence between the individual linguistic units. In this paper, we enable character-level NMT for Chinese, by breaking down Chinese characters into linguistic units similar to that of Indo-European languages. We use the Wubi encoding scheme, which preserves the original shape and semantic information of the characters, while also being reversible. We show promising results from training Wubi-based models on the character- and subword-level with recurrent as well as convolutional models.

Authors

4