Then you cannot recharge. If his termination of the lease does not cost any material damage, then you would have to return the security deposit back to him.
If i were you , i would pay new tenants X amount of cleaning charge and deduct X amount from the SD and return the rest to him. Then when the new tenants move out and they do not clean the apartment, you could charge reasonable fee in cleaning from new tenants.