Simple past (went) is often used with a word or phrase that indicates when you did something. I went to the office yesterday. Present perfect is usually used without being specific about time. I have gone to the city. It sounds a bit odd in English because if you have gone, you aren't here, so can't be talking to the person, except maybe on the phone or in a note.