Even they took your I797 in for issuing visa, they will return to you when you get your visa back. Worst case scenario, if the I797 is lost you can still file for a replacement I797 to USCIS.
You can send your original I797 back. When your family is done, then send it back to you. Don;t worry too much about it.