Definitely. Peace of mind. Give tenant the number

to call and let tenant arrange the repair whenever there is a problem. Even better if you let tenant pay the deductible. A lot of landlords are doing that if you look at the rental houses on MRLS. The ads often state repair deductibles, filter/bulb changes, gutter/chimney cleaning, yard maintenance etc as tenant's responsibilities.

Don't be the slave your tenants!