Would "della nostra" be considered incorrect? or maybe in this situation we have multiple houses
I think perhaps the latter, since the speaker is referring to a plural group (i.e. us). This sentence might be said, for example, if two city-dwellers (each with their own house) went to a country house.