If you think what you said last time is right according to your own best knowledge, then you did nothing wrong and no need to feel guilty. If you think what you said last time is not right (the content is not right, not about whether you should speak out or not), then you should prepare to make clear of yourself when the time is right, like in a similar meeting, or when others ask you.
Try your best to understand the situation, try you best to do the right thing, don't try your best to get along with wrong person. Try to do things you will be proud of yourself and willing to share with your family and friends.
Doing right things might cause you to pay sometimes, but at the long run, you will be rewarded from it, by earning the respect and friendship from the right person.
