Isn't the point of cardinal directions that they don't change from one person to another. You can have "your own right", but North is everybody's at the same time.

‘The border is to your north’ would seem better.