the code requires all bathrooms, either have exhaust fan or a window.
if you have exhaust fans, replace it with a new type which has build in heating elements.
if you have windows, you may consider baseboard heater, but that also mean you need to run a new 220v line to each bathroom.