Could you also say "zwiedzam w starym mieście"?
No, I do not think so. Maybe in some specific situation, but it would change the meaning.
but you can say zwiedzam muzeum w starym mieście- i am visiting/sightseeing a museum in the old town.
We are sightseeing / zwiedzamy something (accusative).