Lots of people moved after they ted their I-485,nothing affected their GC. why should you worry so much? The only thing you need to do is update your address either online or mail, even both of them ontime and follow up your case. I do not think it is hard to do. Especially you have a lawyer. Many people do not have lawyer , did everything by themselves.