«Напра́во» and «нале́во» are directions, not locations. They could sound OK only if the speaker is going towards the house, but «спра́ва» and «сле́ва» are OK in other situations too.

[ влево вправо ‧ налево направо ‧ ( transit ) leftward rightward ]
[ слева направо ‧ ( transit ) from left to right ]
[ налева справо ‧ ( transit ) from right to left ]
context.reverso.net/translation/russian-english/налева+справо

направление ‧ direction [ cultural right handedness bias similar to Latin, English & others ]

Dexter ‧ the bearer's right side / dexterity good
Sinister ‧ the bearer's left side - evil, unlucky, not good

The Right way ‧ The Wrong way
Not in their right mind

www.smithsonianmag.com/smart-news/two-thirds-of-the-world-still-hates-lefties-64727388/

www.edinburghneuroscience.ed.ac.uk/news/right-side-bias-choosing-aircraft-seating

You can't rely on the dictionary hints / hover hints / suggestions. They are often wrong, misleading, or incomplete.

But since дом is masculine, I hope you recognize that твоя is feminine, so that the correct pronoun is твой.