It is the common mistake for a healthy man

Forgive him. It is just some physical desire that will not hurt the family. It is more important to maintain the family. The best way for you is to exhaust his energy every night so he does not have the power to look at any other woman.