The real question is: does the Spirit Temple or the Shadow Temple come first?? :P
That's how I always did it as well. I'm of the minority amongst my friends.
Sucks that you can go inside the volcano as young Link but can't reach the Fire Temple.