don't you have a column for

comments on the evaluation form? If yes, then you can sign and put on notes that you agree what he says, in addition, you'd also like to see some positive sides so that you would know where your strength lies. By giving such comments you are not complaining, but giving him feedback so that he can be a better manager. If he is a decent man, he sould take it well.