I guess that's what I would say. It's not a sentiment I think I've ever expressed. Usually a house is big (height and width and length), and not just tall (although I guess in London you can find some really narrow houses that are tall and long since road frontage was expensive when they were built). The house is very tall works. It doesn't sound odd, and I honestly don't know what other word I would use to express that the house isn't lacking in height. You wouldn't say "the house is very high" as that would lead one to believe it was up on a hill or mountain. Hope that helps.