- Forum >
- Topic: Duolingo >
- Test Out Temporarily Disabled
Test Out Temporarily Disabled
As some of you may have noticed, we recently started rolling out an A/B test that allows some users to test out of a specific level of a skill. Unfortunately, in order to reduce the stress on our systems while we debug an issue, we had to temporarily pause this experiment for everyone. Thank you for your patience; we realize this feature is important to many of you, and rest assured we are working hard to find a resolution as soon as possible.
Update 6/23/18: We have turned the experiment back on :)
148 Comments
2091
Thanks for posting and explaining what's going on. I really love the new feature, too! Best of luck with the debugging.
1080
It is an amazing and very important feature, I would like to see it back as soon as possible. Keep up the good work!
115
By the way, I LOVE IT! Wow, the test out function is so exciting! Honestly, I thought I had just hit the jackpot in Las Vegas as I watched all those XPs ring up! Phenomenal! Keep up the great work!
1577
Merci beaucoup pour le poste !
I was so happy this morning when I saw "the key". I tested out of 3 levels then figured I'd get back to it this evening.
Except the keys were gone! I was in a panic. Maybe check Dutch or Spanish , log out and back in , shut down the browser and restart.
No , I'm not crazy , there was a key symbol there this morning. Wasn't there? Maybe I just dreamt it.
Then I found your post. This is a very useful feature for me and it really energized me. This will allow me to quickly catch up to the level of French I had pre-crowns , then slow down and work on the new French 3.0 material.
I sure hope I am one of the people who gets this back. I went through 560 iterations of "Je suis un(e) X" over 2 trees.
2091
I've been receiving 1 lingot each time I jump up a crown level without losing any hearts.
1674
Dear DarthDuo: May the fourth be with you and your efforts to fix the system. This feature was Imperial!
1790
* Die Funktion :)
Kleiner Tipp:
Alle Wörter, die die Endung „-tion“ haben, sind weiblich.
1040
I have found that the test questions are too easy. I am being given mostly Spanish prompts to translate to English whether I am testing out of level 0 or level 4. I would say that at level 4, nearly all responses should be in the target language, and that at level 5, questions are wrong if missing the accents.
1814
I agree. The tests are so easy that it is no challenge. I do use the test out feature and like it a lot, but only for skills which I know so well that I am absolutely sure that I no longer need to practice them.
Waiting for access to test-out with bated breath under crownS of thorns! The feature was available for individual skills well before the coronal system was implemented. It's subsequent removal, combined with the loading of often boringly redundant course material, would be a large speed bump for most longer-term learners.
In any case, going by popular demand, I would say that such test-out should now be considered a crucial given (if not an important course correction), A/B testing or no. To decide otherwise arguably amounts to nothing more or less than ghastly, cruel human experimentation on both the A test group and the B control group, especially considering all the heightened expectations.
Still love ya Duo and volunteers ... please get in-skill test-out going for everyone ASAP. Meantime I'm largely reduced to timed practice---or ranting and raving on discussion posts!
Respectfully ...
308
What a relief...I tested out of many skills yesterday and today the option was gone! Glad you are working on fixing it because it really makes practice more enjoyable. I hated repeating the super simple things. Thanks!
2211
Please keep this feature. Between this and the addition of Hawaiian into the incubator, I feel like Duolingo is finally starting to come back on the right track after a long period of uncertainty.
If only you got spaced repetition integrated with the crown system, then everything would be perfect!
192
Just got the “pleasure” of losing 40-50 “un-lose-able” crowns with the rollout of new Spanish Tree. I would be totally ok with losing crowns as long as I was learning something new. I checked out one of the “new” subject areas, “Travel”. I was put through re-learning “maleta” “hotel” “taxi” etc. Definitely not “new” stuff. The “new Spanish Tree” rollout should be stopped and folks already subjected to this should be be able to roll back to the previous tree until test out really works and/or the initial calibration is vastly improved.
373
That happened to me too. I was so close to giving up on Duolingo but now with the test out I can get my tree back with so much less repetition of basic material.
As long as this isn't a cover-up to permanently removing the feature, I'm all for it.
Holy mother of Ahura Mazda, I thought that said “permanently” when I first saw it!
1545
Mir gefällt diese neue Möglichkeit auch sehr gut und ich freue mich sehr, wenn es schnell wieder funktioniert. Danke für das Feature u d die Bemühungen das Problem so schnell als möglich zu lösen :)
1507
Thanks so much for working on the weekend to enable this feature again! The possibility to test out of a skill level is great :-)
Please hurry. I don't think I can live without it now. And it has, btw, been beautifully calibrated: the units I've tested out of have been ones that would have driven me crazy, probably three days to get through, while where I haven't passed, there were real "oh, I didn't know that" moments in the unit.
492
I happened to notice it yesterday and tested out of several subject levels. It's a nice feature. It gets really boring otherwise.
Whoa! Lots of comments here to parse, so if I'm beating a dead horse I apologize in advance.
Basically, I see some "flaws" in the testing out feature and thought I would address them (maybe to the detriment of some users, but they should be few so sorry in advance to them as well). I put flaws in quotes because maybe they aren't actually flaws. Anyways, without further delay ...
Testing out of a skill on my phone vs computer is a very different experience. From what testing I did (all of it was on the German tree where I feel comfortable testing out of skills), the computer version was fairly consistent with how many questions you had to answer while the mobile version often times made it too easy with very few questions. Sometimes so easy in fact that it was impossible to fail testing out of certain skills.
So let me give an example. We are going to use the Past Perfect section of the German tree where I'm currently Level 2. I saved this one partially because of how easy it was to test out, but mostly because I feel I still need practice the skills of the lesson and didn't want to hurt my own progress for the sake of crowns.
In this example, if I were to test out of it on my computer, I would be greeted with 15-17 questions (not sure on the exact number since it's one solid bar) of which 3 could be wrong before I had to start over. However, if I did the exact same test on my phone, I would only have to answer 2 questions of which 3 could be wrong. What that effectively means is no matter how I did on the only 2 questions it asked me, I would level up regardless. Even worse, sometimes it's basically the same question, but instead of translating from English to German, I might have to do the reverse, but with the same sentence. This means that if you got the first question right, it's basically a shoo-in for the next answer.
Now this might be part of what is causing this to occur, but it almost seems like there is a smaller pool of sentences to pull from for mobile versions of Duolingo. Even with some of the tests that had a larger set of questions, they felt more re-hashed on mobile than on PC. This might not be an easily solvable problem, but I would at least rather be greeted with ~15 questions that are fairly similar but still test me.
OK, now going even further down the rabbit hole, this might be dependent somewhat on the language, but there is a lot of variability with the amount of questions within the same lesson. For example, the Fantasy lesson had about 4 questions each for testing out of Levels 1, 2 and 3, but to test out of Level 4 you needed to answer about 15 (which was nice). I also saw this happen in other lessons but where the reverse was true. Where the first few tests would be a high quantity of questions but the last couple lessons would only be ~4-8.
Anyways, I already abused it more than I probably should have (but I feel comfortable in the lessons I tested out of), but in an effort to stop people who aren't ready to test out, I thought I'd bring it to your attention. Good stuff so far though! This isn't really a complaint so much as bringing it to your attention. Keep up the good work!
2091
I've been testing out of crown levels for the last three weeks. Here's my review:
Most importantly, the test out feature is an excellent feature that should be available to all users. In fact, it's so necessary and powerful that if it's not implemented for all users then I'd argue that any users who haven't had access to it yet should receive access for the same amount of time as the test group, in order to rebalance Duolingo's crown levels and XP.
The normal pathway of doing lessons to move up crown levels is too repetitive and easy, making the process feel like a mind-numbing grind. Despite that, prior to the test-out feature coming to my account, I couldn't keep myself from grinding out the early crown levels on my trees. I knew my efforts would be better spent on the mid to later sections of my trees, but I strongly disliked how the low crown levels at the start of my tree felt like they were reflecting a much lower knowledge of those skills than I knew I possessed. That feeling, and an urge to have my entire tree complete again, caused me to waste too much time on early skill crown levels.
I understand the rationale of the crown levels, but don't think that vision is coming across in practice. I would love for my tree to include more complex sentence structures, vocab, skills, and sentences to practice. However, in all of the crown levels I worked on throughout my trees I never noticed anything new and noticeably more difficult. But I did notice several skills that honestly required 50 lessons to move from crown level 4 to crown level 5. How is that justifiable? Anyone who gets to level 4 will already have put a lot of practice into that skill, and I simply don't see enough complexity or new material added between crown levels 4 and 5 to justify 50 new lessons to complete.
I noticed that the tests were not perfect, but seemed to get better either over the three weeks or as I moved down my trees. I only tested out on the web version on my computer. In one test I had the sentence "Katzen schlafen überall" four times in the same test, which tested my knowledge the first time and gave me easy correct answers the other three. I've also noticed mostly the same questions repeated in each level whether I was testing out of crown level 2, 3, 4, or 5. The format of the question/answer got more difficult as I went along, in the early crown levels with more word bank answers, then later translating from the target language, then later translating into the target language. That actually made testing out easier the more crown levels I had available to test because the more levels I did the more times I saw the same sentences over and over, which made the increasingly difficult formats not that difficult due to me already being familiar with the test sentences.
However, the test out feature is still an enormous improvement. My three main trees are beautiful and golden again. Testing out of the crown levels for each skill has resulted in me refreshing my way down my trees at a fast enough pace to be appropriate for my level, and now that all three of my main trees are refreshed I can go back to using "Practice All" every day, focussing on reviewing the content I actually should be learning instead of getting bogged down in grinding the beginner skills. That is the reason why this feature needs to be given to everyone, so the people who would be helped by it in the same way that I've been helped can have that opportunity.
The lack of transparency for skill strength that the crown levels have brought to the trees is a big problem. The Spaced Repetition System on Duolingo is a feature that I highly value and trust. I used to be able to quickly see which skills on my tree needed to be practiced and refreshed. Losing that information when the skill colours changed to reflect crown levels rather than skill strength, combined with trees wallowing in low crown levels with ridiculous numbers of lessons required in order to raise them, made me feel both overwhelmed and lacking direction. The only options on Duolingo being the "Practice All" button or blindly practicing individual skills without knowing their skill strength is not enough.
Thankfully, just over three weeks ago I discovered Duome for the first time, and seeing my individual skill strengths and total tree strengths gave me an enormous amount of motivation and direction. I understand that a fine balance is required, as any feature might motivate some users while simultaneously demotivating others. However it's achieved, I think it's incredibly important to get the knowledge of what needs to be practiced back into the hands of Duolingo users.
That about wraps up my review. I hope it was helpful, and as always, Duolingo, thank you. I really love this site. Now that my trees are refreshed I'm looking forward to keeping my three main trees full strength, doing more Duolingo Stories, and starting back in on learning Spanish. Plus waiting for my account to get access to the new Esperanto and Spanish trees, though after being fortunate enough to be in this test group I'm more than happy being as patient as necessary.
And for anyone who wants their skill and tree strength information and hasn't yet discovered duome, just go to www.duome.eu/[YourDuolingoUsername]/progress and be amazed.
1668
Currently, the "test out of individual skill" feature is only available in the iOS App in "Crown level" 0
- Use www.duolingo.com in your device's browser to level up from "crown level" 1-5
- or use the Android App.
355
When is this feature being re-implemented in the app for all users? I am currently using Duo to practice Greek, which I've studied in ancient and modern forms for the last 10 years and I do NOT need 96 lessons to become fluent/level 5 in the Greek alphabet. Additionally, the lesson tips are not visible in my latest app update (ios 5.2.43) on any lesson, despite the fact that this is exactly what that update promised? Previous updates have shown tips just fine.
1508
@Bmamer
Quote: I noticed the feature was available yesterday, but not today?
Do you mean on the mobile app or the web portal?
You can find different A/B groups for mobile vs web in your "extended user profile" and theoretically, you could have been swapped from the one group to the other.
Or maybe a mobile app update (if you did that) has removed it by mistake...who knows...
Use this link on the web portal to get it back and access the barbell PRACTICE button, if the key button is still not accessible for you on the www.duolingo.com web portal: http://www.duome.eu/USERNAME/progress
about testing out... I have a question:
I already reached level 25 in some of my languages, and 100000XP – but with the crown feature a lot of the lessons started to look incomplete. I don't have the option of testing out, because I have already done the tree.
What do you recommend doing?
Do I need to reset the tree, in order to take advantage of the test-out feature?
If I do a reset, will I lose all the accumulated XP for that language?
Thank you for answering my questions!
1405
It was test out skill level, jump crown levels, not overall language level. No need to reset anything (and if you reset you will lose xp for that language). When we get the feature back, you can easily (you still need to work a lot, but easier than doing all the new lessons) make your trees golden, just jump from crown level 1 to 2 to .... gold.
I never heard of this feature. Sounds good! Would it have helped me reach Level 25 in Spanish faster? I finally made it to Level 25 yesterday with 30004 XPs, all of them earned by slogging through the lessons in hundreds of hours over the last three-and-a-half years. I guess this means the Levels have been devalued, right? When I reached Level 23 last November, there were the usual lingots and trumpet fanfare for leveling up. Not so in April when I hit Level 24 nor yesterday at Level 25. Looking forward to this test out feature so I can try it out on another language. Duo on!
592
I only used it for the very first time yesterday, and absolutely LOVED it! (Half wondered if I had broken it somehow till I saw this post.) Can't wait for it to come back! :)
1508
Olá @Alternativapet,
Quote: Here already came will back.
A little correction: You probably mean: /
Uma pequena correção: Você provavelmente quer dizer:
"It is already here. It will come back."?!?
In the above example you are using the wrong word order, in combination with past + future (will) at the same time.
Will + past would wrong too.
The first part and the second sentence part can not be mixed easily as you are doing it.
Also it would help to read "What" is here already".
However, you could use the "and" conjunction to connect both parts ("Here already" is still not sufficient).
Sorry, can not explain the English grammar to you in Portuguese :(
Muitas saudações da Alemanha
1322
damn I only discovered it today, so I finally finished my tree because it was missing less than thirty crowns.
I have the most current app on my iPhone. In German, after selecting a category, a small orange box appears with options to skip a level or start. In Spanish when I choose a category, the entire screen turns reddish orange and there are two “fast-forward” arrows in the upper right. Touching there opens up the option to skip a level. In both courses, it costs 400 gems. I don’t know if they are phasing in these updates, of if there is a difference in Apple vs. Android - just sharing what I see.
1508
@territech
Only IOS has the GEMS currency which you have to pay with real $$$.
AFAIK Android was the first mobile plattform of the A/B "skill crown level test".
I have not tried with a more recent app version, but I think it is free if you are in the right A/B group....if it costs lingots (which I don't think), then it's no problem either.
The www.duolingo.com web portal was the first plattform where the "A/B skill crown level test" was rolled out.
As the web portal makes use of typing instead of tapping word banks (with given hints = too easy), the test-out is much more accurate if you do not do it on the mobile (tapping) apps!
I just can wonder why you guys all want to use the mobile apps - with tapping - to level up in crowns and test them out.
This makes like 0,1% sense :-)
Want to try how tapping harms your accurate language level?
Test out the EN->PT course on the mobile app.
Try to get to level 9...pass several checkpoints.
If you fail with the intro placement test, you can continue with all the checkpoint (there are 10!!) or skill tests.
When I did it for the EN->SP course on Duolingo last year in summer - after I had been learning Portuguese for at least for 9 months, I was able to pass lvl9 and test out multiple Spanish skills on the Android app.
However, I failed two times before on the web portal (type what you hear, typing translations into from English->Spanish, or Spanish->English, etc.)
1508
I still fail the web portal intro placement test for my EN-PT 91 skill tree (update in June 2018, which is final already) for all skills / checkpoints.
It is way too hard...even after two years.
1248
Thanks for explaining this - like others i was bummed to see it gone and I am thrilled to know that you are working to bring it back.
Using iPhone, when you select a category, a dialog box appears that shows the number of lessons (completed and total) in the current level. In the upper right corner of that dialog is a picture of a key. Click the key and you will have the option to test out in exchange for some gems, which you will earn by completing lessons or watching commercials.
Thanks, those look like really clear instructions. Unfortunately that’s not what I see on my iPad. I get the key in the browser dialogue box so ai know what you mean but it’s not there on the app. I do, on the very newest levels, have the option of “skip level” with a fast-forward symbol. I wonder if that’s all there is on the iPad app.
Seems odd that the iPhone would have it and the iPad not though.
After reading your post, I explored further and I found that in the Spanish tree (on the iPhone app) there is a fast-forward icon for Skip. On the German course, where I have been working this week, there is a key. In both cases, the cost is 400 gems to take a test to skip to the next level. On the web I can test out for free. I would have to watch a lot of commercials to get enough gems to test out of many categories; therefore, I generally use the web version rather than the mobile ap.