Do worry too much.

找个律师问一下.one of my friends has the same problem, but she got the citizenship. As long as you still ok with your wife, show the officer that you have happy life now, it should be OK. Do't lie on the application.
Good luck!