Hm, you could use it for that, but most would understand it as a physical context. But, if you change "drar" with "går" it would be a metaphor for breaking up that is very commonly used. "Hun går fra ham" -> "She is leaving (walking away from) him"
You cannot translate word for word from one language to another "drar fra" means "leave". The Norwegian verb requires the preposition, while the English verb does not this time. "fra" does mean "from", which we do use with the verb "goes", but not in this context.
fra ham does translate to from him, but in this case think of the preposition as belonging to the verb drar. Hence, the phrase is drar fra and means leave; English doesn't (normally) use a preposition with the verb leave.