You don't need please everybody in your team. The only person

you need to please is your boss. Try to keep professional relationship with your colleague and your boss too. I fought will a white woman before in my team, she tried to isolate me but I really didn't care. When I needed to do small talk, I talked to people in different dept. I only talked some topics I knew very well and I felt comfort with. Please try to be tough!!! Don't get beat down by them!