Agree: his marriage boundary is a red flag

When he feel bored or unhappy sex, get divored. It shows he lacks ability to move on a healthy relationship. 

The key for a long term marriage is to improve self day by day but not give up. If he gives up for the first time, he will check out the second time when in difficulties.