It would be the same in German, as the adverb goes after the verb in German - you can't express the other possibility by putting the adverb at the end.
You could explicitly say weniger oft "less often", of course, or use nicht so viel "not so much" versus nicht so oft "not so often".
Why weniger and not wenige?
The -er is the comparative affix, turning wenig "little" to weniger "less".
As for why there is no gender/number/case ending (one might expect wenigere Milch with -e to agree with feminine accusative Milch) -- I think this is simply an exception to remember.
viel (much) also usually has no gender/number/case ending in the singular: ich trinke viel Milch "I drink a lot of milk", and mehr (more) never does: ich trinke mehr Milch als du "I drink more milk than you".