Because then there would be two "to"'s in the sentence. :)
Anyway, this is probably a closer translation:
"We move to Hungary from America."
For "We move from America to Hungary", I would say "Amerikából Magyarországra költözünk."
But these are tiny differences, your version should certainly be accepted, along with Yoda's.