just tell the bank that you want to terminate the contract

based on the inspection report. Make sure you submit the termination form before the contingency period. depends on the state, passing the deadline may indicate contingency removal.