It doesn't sound like you should go back, especially 两年来初有起色我也很喜欢。
"中止我喜欢的去做一个我不喜欢的" is a big no no. Especially there is no garuantee of a future with 我不喜欢的
but don't understand why 想到孩子还有几年上大学,我还要回去工作很多不情愿, Can't you contunue your own business even after your child go to collegue? Is going back to work is something that will eventually happen? Then it may be a different story.