Win your manger over first.

You need to win the manager over first. If he just get hired, the manager should trust you more. You cannot say you are not willing to help if it is part of you job. Even it is not part of your job, you are expected to lend a helping hand, as long as his request is related to work only. If helping him is not part of your job, you should be able to postpone it, "forever". You can ask the manager for more responsibilities, report to him/her often, have a casual chat once in a while. When it comes to "help" him, try email, try bad solutions, try asking him more questions to make your "help" a waste of time. If you think the manager likes you better, you can ease your manager in slowly about this touchy situation, say unintentionally mention it as an annoyance, or as a joke.

If you are married, or have a boyfriend, this should be even easier. Invite your manager for a causal dinner with your significant others, then your boyfriend or hu*****and can mention about this annoyed person casually.