It sounds odd, and it seems to give a different feeling. If you say "every Monday", you're expressing that you go there week by week. Whenever a Monday comes around, you'll go to the office.
With "on all Mondays" you're tying these days together. It's less about your weekly schedule, but rather about what time you occupy, what you want to take for yourself.