If there is no contingience, it is hard to deal with it. Otherwise, you can find next deal. Normally, you can ignore agent's opinion, but he still gets paid if you close this deal.