If for any reason you are not happy, just do not buy.
I had an offer on a condo, offer accepted. Before removing all the conditions (e.g. inspection, etc) I decided not to buy and informed my agent and walked away. Here in Canada only when all condition removed you pay a deposit, as you are ready to close the deal.