While it's true that visit can also mean zwiedzać, you don't go to a bank to marvel at the architecture, but to get something done.