The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English

Loading...
Thumbnail Image

Access rights

openAccess
publishedVersion

URL

Journal Title

Journal ISSN

Volume Title

A4 Artikkeli konferenssijulkaisussa

Major/Subject

Mcode

Degree programme

Language

en

Pages

15

Series

Third Conference on Machine Translation (WMT18); Brussels, Belgium, Volume 2, pp. 546-560

Abstract

Progress in the quality of machine translation output calls for new automatic evaluation procedures and metrics. In this paper, we extend the Morpheval protocol introduced by Burlot and Yvon (2017) for the English-toCzech and English-to-Latvian translation directions to three additional language pairs, and report its use to analyze the results of WMT 2018’s participants for these language pairs. Considering additional, typologically varied source and target languages also enables us to draw some generalizations regarding this morphology-oriented evaluation procedure

Description

| openaire: EC/H2020/780069/EU//MeMAD

Other note

Citation

Burlot, F, Scherrer, Y, Ravishankar, V, Bojar, O, Grönroos, S-A, Koponen, M, Nieminen, T & Yvon, F 2018, The WMT'18 Morpheval test suites for English-Czech, English-German, English-Finnish and Turkish-English. in Third Conference on Machine Translation (WMT18); Brussels, Belgium. vol. 2, Association for Computational Linguistics, pp. 546-560, Conference on Machine Translation, Brussels, Belgium, 31/10/2018. < http://aclweb.org/anthology/W18-6433 >