https://www.duolingo.com/I_Am_Robin

Re-gilded my tree for 2.0

  • 25
  • 15
  • 15
  • 13
  • 12
  • 11

I've been waiting ages for this. I'm obviously upset that I didn't get into the A/B testing but it has allowed me a heads-up to re-gild my tree so that when I do get the new tree everything that is new will be the only things I need to strengthen.

How long does an A/B usually last? It felt like forever when I was selected for some bad tests on the mobile, but it's been a few weeks now, so probably reasonable to assume I get it next week?

I know I can create a new account, but I don't want to spend forever re-strengthening basic words as I refuse to progress if I have any skills not gold.

9/10/2017, 6:28:18 PM

7 Comments


https://www.duolingo.com/Cian8656
  • 20
  • 19
  • 10

They shouldn't even be doing an A/B test because the tree is clearly superior, almost objectively so in that in teaches approximately 1000 additional words, has more tips and notes and lessons for concepts that weren't taught before.

The A/B test doesn't isn't for testing which tree is better at teaching, only which group has a higher retention rate of users, i.e. which group watches more ads

9/11/2017, 10:40:39 AM

https://www.duolingo.com/I_Am_Robin
  • 25
  • 15
  • 15
  • 13
  • 12
  • 11

Yeah that's pretty much what I've read, which is why so many people are creating new accounts for it. Hopefully that'll show a drop in retention on the current tree and speed up the process.

9/12/2017, 7:21:45 PM

https://www.duolingo.com/lavendeltee
  • 19
  • 15
  • 14
  • 13
  • 11
  • 11
  • 8
  • 3

It may depend. To end up the A/B test, one needs a significant difference in the drop out rate. The developers have to make it is clear that the percentage of the students who quit learning after having taken a few lessons of the new tree is significantly lower than it used to be with the old tree. One needs time to gain the statistics.

9/10/2017, 10:02:42 PM

https://www.duolingo.com/Simius
Mod
  • 19
  • 12
  • 11
  • 9

That's true. And we need a developer who cares to check the results and communicates with the team of volunteers. That's not a given at all. The Norwegian course has been A/B testing their new tree for over 6 months now, but the Duolingo staff is ignoring their requests for an update.

9/11/2017, 7:28:51 AM

https://www.duolingo.com/I_Am_Robin
  • 25
  • 15
  • 15
  • 13
  • 12
  • 11

Oh I didn't realise they'd been A/B testing for so long. That's really stupid, I understand the most part but a 'significant' different doesn't make sense to me. You've spent the resource on creating a new tree already. If it's just the same retention then to release it fully would give no drawbacks but improve the total quality of the course? They should just release it on the grounds of breaking even, in my opinion, that's what we do where I work.

9/12/2017, 7:24:27 PM

https://www.duolingo.com/Simius
Mod
  • 19
  • 12
  • 11
  • 9

The new Norwegian tree has just passed their A/B test, after all this time, so that's promising for us!

9/15/2017, 8:32:01 AM

https://www.duolingo.com/I_Am_Robin
  • 25
  • 15
  • 15
  • 13
  • 12
  • 11

haha great, my tree didn't change which means I must've been in the A/B for Norwegian this whole time!

9/23/2017, 10:34:04 PM
Learn Dutch in just 5 minutes a day. For free.