No, your lawyer has no right to withdraw your case. However, I would suggest you to have a peaceful talk with your lawyer to make the transition as smooth as possible.