Toxicity of mercury should not be in any doubt.
The fact that not everyone suffers from mercury does not mean that mercury is not toxic.
Nuclear bombs in Japan did not kill everyone who received radiation and there are many survivors, but that does not mean A-bomb does not kill.
Further, no clinically significant symptoms do not mean damages are not there.