https://www.duolingo.com/olimo

Some thoughts on certificate test

  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

I've just taken a French test and got a certificate. It was fun to test myself, but I have a few comments and suggestions for certificate test.

The test does not give you any information except the final score:

  • You don't even know if your answers are right or wrong.

  • We all know there are mistakes on Duolingo and some valid answers are not accepted - why not have a Report function in the test, too? Besides, it would be nice to know if you we really wrong or you just hit an answer that is not in the database.

  • Why not show the number of correct answers vs total number of questions in the result? Perhaps this is not necessary in the certificate itself, but in the "Congratulations" message that would be cool. Any other statistics would also be appreciated, like "your vocabulary is good, but you have to work on Past tense", etc.

Could there be some progress indicator? It is a little frustrating when you have no idea how long you still have to work on the test or how many questions are left.

It would be nice to have a note in the stream, like "olimo passed the French test with the score of..."

October 11, 2013

35 Comments


https://www.duolingo.com/severin
Plus
  • 22
  • 14
  • 11
  • 5
  • 5
  • 4
  • 4
  • 2
  • 212

Hi Olimo,

These are good questions. The certificate test is currently in beta and we just started exploring this space. So what you see is work in progress.

The goal of the certificate test is to figure out your language level as accurately as possible (we're not trying to teach with the certificate tests). There is a chance that giving feedback on answers counter-acts this goal (by biasing you in one or the other direction). That's why we currently don't give feedback.

I like the stream message as an option (because you may not want to post to the stream if you get a low score :)).

I hope that makes sense.

-Severin

October 11, 2013

https://www.duolingo.com/olimo
  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

What about giving an overview of the user's answers after the test is completed? This won't bias anything and the user will have a chance to know his/her weaknesses or research the topics he/she does not remember well. I believe the questions are not always the same in a test as it seems they are taken from the lessons (so there are a lot of other questions left for future tests).

October 11, 2013

https://www.duolingo.com/severin
Plus
  • 22
  • 14
  • 11
  • 5
  • 5
  • 4
  • 4
  • 2
  • 212

yes, that's something to consider.

October 11, 2013

https://www.duolingo.com/dnovinc
  • 22
  • 20
  • 13
  • 9
  • 4
  • 4

When I had taken an Italian test it felt a bit uncomfortable because we are so used to getting instant feedback. In my opinion when we are doing a test for a certificate it should be like that, we shouldn't get instant feedback. (edit: Perhaps even shortcuts could be like that, to make them a bit more difficult...)

Instead of showing us the solution after each question it would be great if they implemented the Review option from hackathon. So when we are finished with the test we can review all our answers. http://blog.duolingo.com/post/62723181502/duolingos-inaugural-hackathon

I totally agree a progress indicator would be great.

Some people don't want their scores to be public so Duolingo team could make a "publish" option for users that want to have their score visible to everyone.

October 11, 2013

https://www.duolingo.com/0liwia
  • 20
  • 19
  • 17
  • 14
  • 14
  • 8
  • 2

I think it's a shame you cannot see people's certificates when you go on their profile. If you did well, you should be able to brag about it :-)

October 11, 2013

https://www.duolingo.com/Mike_F.

True.. well not the bragging part, but see that the user has successfully done the test. The user already has the Dou owl at the bottom of the completed tree. Why not give the owl a rolled up parchment or a graduation hat?

October 11, 2013

https://www.duolingo.com/morebros

I like the bragging part ;-)

October 11, 2013

https://www.duolingo.com/LeMaitre
  • 21
  • 15
  • 14
  • 13
  • 11
  • 9
  • 8
  • 8
  • 8
  • 7
  • 6
  • 6
  • 6
  • 5
  • 5
  • 5
  • 4
  • 3
  • 2
  • 2
  • 2

D'accord. I too just did a test myself, and felt that if we got instant corrections, or at least at the end of the test it would help us to evaluate ourselves better.

October 11, 2013

https://www.duolingo.com/lieryan
Plus
  • 25
  • 9
  • 8
  • 8
  • 5
  • 4
  • 510

> "your vocabulary is good, but you have to work on Past tense", etc.

If Duo can make that kind of feedback, why limit it on tests? Why not all exercises?

October 11, 2013

https://www.duolingo.com/kaylastack
  • 14
  • 13
  • 13
  • 10
  • 10
  • 8
  • 8
  • 8
  • 6
  • 6
  • 5
  • 5
  • 4
  • 4
  • 3
  • 3
  • 2
  • 2
  • 15

I am really curious how progress in DuoLingo compares to a typical semester of college coursework or CEFR language proficiency levels. Could we have some sort of indication of that with our scores?

October 11, 2013

https://www.duolingo.com/Zach1337
October 11, 2013

https://www.duolingo.com/ruth-mac
  • 25
  • 23
  • 14
  • 10
  • 7
  • 4
  • 4
  • 4
  • 4
  • 1988

Thanks for the link - it was very interesting to read this report!

October 13, 2013

https://www.duolingo.com/kaylastack
  • 14
  • 13
  • 13
  • 10
  • 10
  • 8
  • 8
  • 8
  • 6
  • 6
  • 5
  • 5
  • 4
  • 4
  • 3
  • 3
  • 2
  • 2
  • 15

Thank you!

October 21, 2013

https://www.duolingo.com/SoccerStripes

Wow! That was an interesting report! Have a lingot.

May 4, 2014

https://www.duolingo.com/BlueChic

I scored 5.00/5.0 on my Spanish test, why can't I brag about it on my profile? :( Just kidding. Anyway, I agree that there should definitely be some kind of feedback, at least to let you know what are your weak sides... that'd be so helpful

October 11, 2013

https://www.duolingo.com/Samsta
  • 17
  • 16
  • 12

Me too! high-five

October 26, 2013

https://www.duolingo.com/BlueChic

:high five: :D

October 26, 2013

https://www.duolingo.com/MultiLinguAlex
  • 25
  • 25
  • 17
  • 13
  • 10
  • 6
  • 5
  • 5
  • 4
  • 2
  • 2
  • 2

I would love to see every trophy or passes exam / certificate as a small icon next to your username so that everybody can see it after directly entering your profile.

October 12, 2013

https://www.duolingo.com/louis.vang
  • 25
  • 24
  • 23
  • 23
  • 16
  • 13
  • 12
  • 11
  • 10
  • 9
  • 7
  • 7
  • 7
  • 5
  • 5
  • 4
  • 4
  • 4
  • 4
  • 3
  • 3
  • 2
  • 2
  • 2

The test is not waterproof: you can do the test with speeking. I tested it: 4.84/5 and i'm just starting to learn the language. Also is it possible that another person the test did for you. Maybe that is a reason why it should not public.

The progress indicator and listing of all the sentences, or only the mistakes should be fine. A test of the different grammatical rules and a certificate for the results for each of them should als be fine.

October 11, 2013

https://www.duolingo.com/BlueChic

People who are THAT bent on having a certificate that they'd resort to cheating should hit themselves in the face. With a brick. I mean, seriously, why on Earth would somebody do that? Yayy, you got a certificate in knowing how to cheat. Good job!

October 11, 2013

https://www.duolingo.com/mptmpt
  • 25
  • 23
  • 21
  • 5

Well people always find ways to rationalize the reasons why they cheat... (for them it is not cheat anyways) so in the cloud, where they live, they are right and they deserve whatever they gain with cheating... I like the idea of hitting themselves with a brick but this might dissolve the cloud they live in and the reality might hit them really hard.

October 12, 2013

https://www.duolingo.com/olimo
  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

Well, it is unofficial and doesn't count anywhere except Duolingo. Sure, cheating is possible, but it is also possible in lessons. What if someone takes a big shortcut and completes a tree for you? You will have a language trophy owl which is public.

October 11, 2013

https://www.duolingo.com/CarolJean1
  • 25
  • 12
  • 10
  • 23

Good to know. I've been considering taking the French ( and maybe German?) test but if there is no feedback and just a score, I don't see the point. I especially agree with your point about statistics. I would want to come away knowing what areas I need to work on. A note in the stream would make sense, and I would have no problem with my scores being made public, good or bad.

October 11, 2013

https://www.duolingo.com/ruth-mac
  • 25
  • 23
  • 14
  • 10
  • 7
  • 4
  • 4
  • 4
  • 4
  • 1988

I accidentally took a German test (which I had just started learning) instead of an Italian test (which I have been learning for a while) so I got myself more lingots and took the Italian test. The embarrassing thing is that I actually scored better on the German one!

October 11, 2013

https://www.duolingo.com/CarolJean1
  • 25
  • 12
  • 10
  • 23

Maybe I'll try the German test after all!

October 12, 2013

https://www.duolingo.com/porquepuedo
  • 25
  • 24
  • 18
  • 12
  • 4

I tried a test once... half of the questions had words I'd never even seen before! :P

October 12, 2013

https://www.duolingo.com/Suijenae

It would be nice to just be tested on just the stuff I have learned. Could a "pre-test" option be provided that just tests you on the levels you have passed? I'd like to know where I am weakest.

October 21, 2013

https://www.duolingo.com/olimo
  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

I guess "Practice lessons" button fits your goal ;-)

October 21, 2013

https://www.duolingo.com/Suijenae

I hadn't thought of them that way. Gracias olimo. :)

October 21, 2013

https://www.duolingo.com/maddyis7

I've just written a similar comment (Under the stream!!) "Certificates" again, and agree with every word you say.

December 22, 2013

https://www.duolingo.com/Luyematsu
  • 25
  • 24
  • 14
  • 9
  • 9
  • 8
  • 230

Is the test a certain number of questions long? Or is it time-based? Or is it flexible depending on how well you're doing or what level you're at? I took the Spanish test for the third time today, and it seemed to take so-o-o much longer this time. Maybe because I skipped fewer questions? ;)

December 27, 2013

https://www.duolingo.com/olimo
  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

I have no idea really, sorry. There was no progress indicator, and I didn't count the questions manually

December 27, 2013

https://www.duolingo.com/DennisVanD6

Thanks

March 13, 2014

https://www.duolingo.com/Kostas00

olimo Hi!! can i ask you how i get the certificate let's say i pass the exams in dutch then what.......do you know ??

February 5, 2015

https://www.duolingo.com/olimo
  • 23
  • 22
  • 20
  • 19
  • 13
  • 10
  • 9
  • 8
  • 7

Hi Kostas! I'm not sure I understand your question. This post is about a Duolingo virtial certificate.

February 5, 2015
Learn a language in just 5 minutes a day. For free.