I'm not judging you here, it's your choice and your life. But

has it ever crossed your mind that the fact you still miss and care about your ex and "can never forget about him" is really not fair to your hu*****and?

Your hu*****and may not be perfect himself and probably has his own vices, but does he really deserve this?

Again, not judging you, but you need to seriously start thinking about the consequences of your action / or no action and the impact on your own family.