When you care too much what others think of you,

you place a burden on their shoulders. Your boss might perceive such burden, thus that you are not carrying your own weight.

You need to believe that your worth has more to do with your courage and willingness to shoulder yourself than what others think of you.

Be aware of how you feel about yourself. Others tend to agree with you.