the fine is on you and you will have to pay it

It is a separate issue from the escrow money you want to go after. I am not sure why it is not in the contract to begin with. But do you have any other written instrument to state such to that effect? You can always go to the court though and I do believe you should go sooner rather than later.