he is not responsible. If divorced, and the house settled under his name, you still need to pay the loan as far as your name is there.