Can this refer to "I go to him" in a somewhat figurative sense, like "Where do you go for answers" "I go to him" or would that be something different? (although given "Wie geht es dir?" I do think gehen can mean more than just physical movement, so that would seem to support it or something similar being possible.)
To add a question: can this also mean going towards him as compromise in a negotiation? Also, the translation of zu to towards has some ambiguousity in it: towards focuses on the direction and implies one didn't get to the destination yet, while to can imply one also reached the destination. Does zu mean one also got to the destination, doesn't say anything or implies one didn't reach? (I think the last option isn't true).