on his yard even if it is your tree and the branches pass the property line on his yard
if your neighbor is worried, he can hire someone to trim it or cut the part on his yard