it's not up to the father, so

They are still remain in the marriage, even they start to divorce, joint custody is very hard to be approved by any party even the judge.
If the father has to go back, why can't he bring the children back? no any sense.