I suspect the boxer as underwear has a different origin than the boxer as trouser. The boxer as underwear originates from the boxing shorts (as in sports shorts). The Dutch Achterhook dialect (a Dutch low saxon dialect) also has a similar sounding word for trousers: boksen. I guess Bukser and boksen have the same Saxon origin whereas boxer has a totally different origin. Quite confusing indeed.