Does pergi also mean went?
Yes. Generally "pergi" is translated as "go/went".
Since dozen is a real word in Bahasa, can we say "dozens of times" like in English?
Yes, you can say "lusinan kali" but it's very uncommon. It's more common to say "puluhan" to refer to a number between 20 and 99.