This is completely equivalent to "they are going to the house of my father"
How come my answer [they are going to the house of my father] got wrong?? Tell me! S'il vous plait!