"Le mari de ma sœur" is "mon beau-frère ... think of it duo !
"Beau-frère" is "brother-in-law". That is good to know. The sentence to translate has "sister's husband", not "brother-in-law", so "beau-frère" is not a correct translation.
Whats wrong with hostile?
hostile seems to be better than antipathique
the right translation of "antipathique" is "unsympathetic"
Can't I use disagréable?
Ou désagreable?
Would the correct translation of the above sentence be: "My husband's sister is very unfriendly"?
No, it wouldn't. "Le mari de ma sœur" is "the husband of my sister", which is "my sister's husband". "My husband's sister" is "la sœur de mon mari".