As time goes by,

this should not be a problem.
It is true that everyone, not just woman, got confused here in this country, especially first a few years. But, eventually, after you settle down, you should be able to find peace in your life. Listen to your heart, that is all. If you wanna quit your job and enjoy life, do it. If you wanna go back to work, do it. It is totally up to you. Do not make life too complicate.