Translation:I do not want to invite them to ride horses.
Wow, interesting! Definitely horse riding where I live. Or just go riding. ‘Horseback riding’ here sounds like you want to be in a western (I even involuntarily see the big hats and the lassoo ...or settlers and wagons).
I would never have guessed that horse riding might have weird connotations in the reverse though. Good to know!