So do feminine words get "à la" while masculine gets "au"? Or am i missing the mark here?
Yes, that's it. au = à+le.
A la montagne, au restaurant.
You'll have à l' before words starting with a vowel.
The plural will be aux for both.