here is the key point: 如果你老板已经有想让你走的企图，

Are you absolutely sure this is his intention? It may be your own insecurity and reflect onto the situation. Talk with your boss first to understand his intention better. He may just need to balance your power with A so that neither of you would surpass him.