"the majority of associate" is horseSh&t here,

If the area is for common use in deeds, the poor guy has every right to use it no matter how the other 3 units say.
You better take that gate down and move on. Otherwise, the guy can sue you to death 'cause he has the case.