Default on Home purchase contract

I bought a new home recently, and haven't closed the home yet. If I opt out right now, is the only I would lose the initial deposit I gave the home builder? Is there any other consequences?

Thanks.