I would like to suggest to add "Let's drink milk" as an available correct option, as it was taught in both ways (you and I, let's) in previous lessons.

I cannot pinpoint the lesson but do know it has been previously accepted both ways.

Mahalo!