We introduce OpenKiwi, a PyTorch-based open source framework for translation quality estimation. OpenKiwi supports training and testing of word-level and sentence-level quality estimation systems, implementing the winning systems of the WMT 2015-18 quality estimation campaigns. We benchmark OpenKiwi on two datasets from WMT 2018 (English-German SMT and NMT), yielding state-of-the-art performance on the word-level tasks and near state-of-the-art in the sentence-level tasks.
OpenKiwi: An Open Source Framework for Quality Estimation
OpenKiwi is a PyTorch framework for translation quality estimation, achieving state-of-the-art performance in word-level tasks and near state-of-the-art in sentence-level tasks using datasets from WMT 2018.
- Year
- 2019
- Venue
- openkiwi-an-open-source-framework-for-quality-1
- Authors
- 5
- Hosting
- Abstract onlyARXIV-DEFAULT
Cite
Notes
Only stored in your browser.
Attribution
- Abstract & full text
- arxiv.org/abs/1902.08646v2ARXIV-DEFAULT
- TL;DR
- Semantic Scholar