New machine translation quality information has been published by Multilizer. The quality statistics made by MT-Qualifier show the quality levels of different machine translation services and how well different services perform as compared to each other.

Multilizer has published a comparison of translation quality from different machine translation (MT) services. The information will bring important value to the usability of automatic translation. Until now the machine translation quality has been either unknown or based on subjective evaluations only. The quality scores in the comparison are objectively calculated by a high-end technology.

The machine translation quality comparison is made with the advanced quality estimation technology from Multilizer. The technology, called MT-Qualifier, is able to estimate translation quality automatically without a reference translation. The noteworthy advance in the quality scores by Multilizer is that they are calculated using the same versatile collection of texts with all the engines. This ensures that the scores are comparable. The data is collected when translating from English to Spanish.

“The quality and especially differences between different MT services is a widely debated subject. Multilizer’s comparison finally gives facts for this debate, instead of estimates by people translating different kinds of texts and having different views and requirements about the quality. As is well known, the quality of MT depends not only on the MT service itself but also on the languages used, the text type and the writing style, to name just a few factors,” says Niko Papula, Managing Director of Multilizer.

With the statistics, Multilizer wishes to bring real data into the conversation of MT usability. The sometimes heated debate has mainly consisted of opinions and disparate experiences. The big picture has remained unclear. Modern language technologies with numerical and measurable data enable an objective point of view to the subject on MT quality.

Machine translation quality statistics are now available here: