Your transaction with the bank will not affect the house's status with IRS. As far as I know, you may not have two primary residences.