unless you can still receive all mails from your previous address, yes, you may have trouble for not getting mails from USCIS.