ignore it. this is the only way to deal with it,

unless you have hard evidence someone said this. otherwise, it is like the scent of perfume, you can never actually catch it. Rumor is a veyr deadly weapon. You can however poke yoru manager to see if he has heard about it. usually if you have, he must have too. if he did, discuss this with him how to deal with it.