WIT3

Web Inventory of Transcribed and Translated Talks

Home 2013-01 MT results

Performance of baseline SMT systems are provided below; for all language pairs but Slovenian-English, scores refer to tst2010 development set, having dev2010 been used for tuning. For Slovenian-English, scores refer to dev2012, used for tuning as well.

The baseline systems were built upon the open-source MT toolkit Moses in a pretty standard configuration, described in the WIT3 paper.

Performance in terms of BLEU% and TER were computed by means of the MultEval software. Automatic translations are linked to entries, just click for getting them.


ar

de

en

es

fa

fr

it

nl

pl

pt-br

ro

ru

sl

tr

zh
ar  Bleu=23.64
TER=57.02
            
de  Bleu=26.73
TER=52.06
            
enBleu=9.60
TER=75.72
Bleu=19.88
TER=58.64
 Bleu=30.73
TER=46.80
Bleu=9.13
TER=75.82
Bleu=29.63
TER=50.69
Bleu=22.30
TER=56.03
Bleu=24.53
TER=50.89
Bleu=9.19
TER=74.27
Bleu=29.88
TER=46.01
Bleu=20.35
TER=60.42
Bleu=12.51
TER=69.48
Bleu=10.35
TER=71.05
Bleu=7.39
TER=76.82
Bleu=8.93
TER=84.39
es  Bleu=36.65
TER=41.40
            
fa  Bleu=12.47
TER=73.35
            
it  Bleu=28.14
TER=51.93
            
nl  Bleu=31.55
TER=48.06
            
pl  Bleu=16.01
TER=67.70
            
pt-br  Bleu=35.57
TER=42.89
            
ro  Bleu=28.54
TER=50.74
            
ru  Bleu=17.19
TER=65.16
            
sl  Bleu=15.75
TER=66.80
            
tr  Bleu=12.48
TER=74.45
            
zh  Bleu=11.56
TER=76.16