If you read the entire sentence...

...he has spent two terms in the Legislature of the State, where he has done yeoman service for the city.

Please note the phrase yeoman service. What does a yeoman do? Would the city pay him a high salary for the yeoman service he rendered?

By the way, the salary for a congressman is capped. Isn't it the tax payers' money?