I would not give him a penny

He is not a reasonable person to even think about asking for the "whole" amount. Let him go through the trouble of suing you and see how far he can go. Make sure to take a picture of that sign if you had not already done so.