Publishing Partner: Cambridge University Press CUP Extra Publisher Login
amazon logo
More Info


New from Oxford University Press!

ad

How Traditions Live and Die

By Olivier Morin

This book brings together cognitive science and quantitative cultural history to look into the causes of cultural survival.


New from Cambridge University Press!

ad

The Acquisition of Heritage Languages

By Silvina Montrul

"This work centres on the grammatical development of the heritage language and the language learning trajectory of heritage speakers, synthesizing recent experimental research."


Academic Paper


Title: Comparing example-based and statistical machine translation
Author: Andy Way
Institution: Dublin City University
Author: Nano Gough
Institution: Dublin City University
Linguistic Field: Computational Linguistics
Abstract: In previous work (Gough and Way 2004), we showed that our Example-Based Machine Translation (EBMT) system improved with respect to both coverage and quality when seeded with increasing amounts of training data, so that it significantly outperformed the on-line MT system Logomedia according to a wide variety of automatic evaluation metrics. While it is perhaps unsurprising that system performance is correlated with the amount of training data, we address in this paper the question of whether a large-scale, robust EBMT system such as ours can outperform a Statistical Machine Translation (SMT) system. We obtained a large English-French translation memory from Sun Microsystems from which we randomly extracted a near 4K test set. The remaining data was split into three training sets, of roughly 50K, 100K and 200K sentence-pairs in order to measure the effect of increasing the size of the training data on the performance of the two systems. Our main observation is that contrary to perceived wisdom in the field, there appears to be little substance to the claim that SMT systems are guaranteed to outperform EBMT systems when confronted with 'enough' training data. Our tests on a 4.8 million word bitext indicate that while SMT appears to outperform our system for French-English on a number of metrics, for English-French, on all but one automatic evaluation metric, the performance of our EBMT system is superior to the baseline SMT model.

CUP AT LINGUIST

This article appears IN Natural Language Engineering Vol. 11, Issue 3, which you can READ on Cambridge's site or on LINGUIST .



Add a new paper
Return to Academic Papers main page
Return to Directory of Linguists main page