One reason is enough: parents' love!

Nothing is more important than that. If you miss three years of the critical development of his childhood, you loss everything: close relationship, willingness to open his heart to you, trust that what you do is for his wellbeing (it's obvious he is not willing to leave), and a lot of other credibilities.... If u can manage, don't do it