when used with můj, svůj, tvůj, jeho and other possessives, muž and žena mean specifically husband and wife
moje žena = my wife
not just some woman that is associated with me, but really the woman I legally married
That is also true in many other contexts.