Agree - think about your priority in life!

I think you should think about your priority in your life. Right now, you are mixed up romantic matter, career, and money, together. In this way, you are hard to make any further move.

Actually, in your case, the key is the romantic matter in office. You should focus this and have it. You should avoid this kind of romantic relation in office, especially with your boss. In my company, both of you will be fired. Besides, the future is very difficult to both of you (divorce is a very long and painful process, and your kids are also a major factor).

You should leave this company and your boss, and this is painful, but will be short. Otherwise, your life will be in a mess in the future.