You can wear whatever you want to go grocery shopping

Just follow the dress code at work.

No one cares what you wear on the street.  No one would even waste a second to look at you, unless you wear no clothes at all.