The reason is he think it is your fault. One obvious evidence is your turn don't yield or you passed the middle and block the way of the other direction. Of course you can say that you stop there and he lost his control. That is why insurance company cannot make the decision.
You can contact with your insurance company. If you lose, I think your insurance company should pay it.