It should be accepted. جدي في بيتي can be meant as both, whether it is (1) "my grandfather is in my house" or (2) "my grandfather in my house".
Or, ... in Duolingo, we can see there is "." (full stop/period) at the end of the statement as the sign that the statement is a sentence. Whilst, there is no "." if the statement is a phrase.