This sentence is quite odd in English. I cannot ver imagine saying this. Is it odd in Hungarian as well?
This is a place where I would use "toward" instead of "to" for the -hez ending. Picture someone on a roof, crawling/climbing up it toward the chimney at the top. Who is climbing toward the chimney?