Can you ask court for sole custody based on him

moving out of state? I don't know detail; you may want to talk to a lawyer.

For now, get the passport renewed by dropping the charge. I think he will not sue you for taking kids back to China without his written permission as far as he does not want the custody -- he can gain nothing by suing you.