https://www.duolingo.com/Soglio

translation evaluations

Soglio
  • 25
  • 25
  • 22
  • 17
  • 17
  • 11
  • 11
  • 8
  • 2
  • 2

How does Duolingo evaluate the quality of translations in the immersion section? Just curious - doesn't it have to be some kind of computer algorithm?

4 years ago

5 Comments


https://www.duolingo.com/Hohenems
Hohenems
  • 25
  • 25
  • 18
  • 14
  • 13
  • 12
  • 11
  • 11
  • 8
  • 7

I'd like to know too.
I once uploaded an article, and was sent an email notification within 30 minutes saying it was completed. When I checked, the estimate said "Good" but the translations were less than stellar, and the English was terrible. One person had translated it, and another one or two had gone through and clicked "Correct" for every sentence. If all it takes is for one or two people to mark every sentence as "Correct", then I think it needs some tweaking.

4 years ago

https://www.duolingo.com/Dessamator
Dessamator
  • 25
  • 14
  • 13
  • 13

I think I read somewhere that in addition to crowdsourcing, it uses spell-check, grammar check, and probably some other tools. I think it probably has some sort of database that consists of a lot of material, and it then checks how close the translations are to text written by professionals or duobot's translation.

But yes I agree that sometimes it just seems nuts. I've also seen a document being completed by only me and two other people accepting or translating.

4 years ago

https://www.duolingo.com/ceaer
ceaer
  • 25
  • 25
  • 23
  • 16
  • 16
  • 226

It looks like there's a new feature now that ranks each person's translation ability and I suppose weighs their translations and their ratings based on their ranking. So that should help prevent garbled translations being classified as good.

4 years ago

https://www.duolingo.com/Soglio
Soglio
  • 25
  • 25
  • 22
  • 17
  • 17
  • 11
  • 11
  • 8
  • 2
  • 2

OK . . . so how do they rate translation ability without rating translations? Is it just a matter of level achieved? Or can I swap some lingots for the title "Brilliant Master Translator"? (<-- joke; intended to be humorous,)

4 years ago

https://www.duolingo.com/ceaer
ceaer
  • 25
  • 25
  • 23
  • 16
  • 16
  • 226

Good point! It looks like the tier system is based on how Duo users rate translations, but you can only move up a tier when you get "good" votes from users at the same tier or above you. So newbies who vote for the most literal translation as "good" would carry less weight. Of course, if high-tier people vote for good translations as bad or vice versa it will still skew things.

This is a brand-new feature (at least to me) so I'm guessing Duo will post a discussion explaining it soon, like they usually do with new features.

4 years ago
Learn a language in just 5 minutes a day. For free.

Learn a language in just 5 minutes a day. For free.