As long as your sponosr does not report this to USCIS to terminate your J1, no one will care about that.