fight fire with fire
Either from the practice of starting back fires to prevent the uncontrolled spread of wildfires,
or from gunfire which is fought by firing back at the enemy.
First thought it were a tongue twister, it did not twist my tongue, an easy one
this is my try, fight fire with fire