It's shame that so many people suggested you to divorce because of this. Everyone is different so put more thoughts on his positive side.