Pls sit down to rank what is your priority in life

More money?
Be good at what you enjoy doing (a.k.a. career)?
Family?
Spent time with kids?
Satisfying or spicy sexual life (within marriage or extra marrital)?
on and on.

Then decide.

Seems you mix everything together, when you get one you want another.