First, other people might not even have time to say bad things about you, especially since saying bad things about others realy makes themself look bad.
Second, If you had some bad experince, why not think twice before you say somthing at work.....
Sometmes, what you see is what you think/who you are, not what they are....
Just my two cents to share....hope you stop worrying too much