Probably not very good English, but what is wrong with 'the man takes the building'?
Nothing :) It's perfectly grammatical and is a correct translation (no matter how silly it might seem in an everyday context...). I've added it as an alternative. Thank you :D
That probably wasn't a good idea, as it will hinder learners who don't know that "tóg" has more than one meaning.
Duolingo lessons aren't just tests of what you already know, they're also the primary way of teaching new knowledge. If "tógann" isn't shown as "build" in exercises where that's a far more sensible translation, then the lesson is failing the student.