"But Congress may by a vote of two-thirds of each House, remove such disability."
The Constitution has said explicitly, as well as the supreme court's ruling, that only CONGRESS can make such decision to remove a candidate off the ballot, by a vote of 2/3 of each house.