I think end of May/start of June is good time to go.
That's before the hurricane season and before peak school holiday really starts, so you are like to find a good deal, especially in May. The whether may have already gotten a little humid and warm, around 85 degrees.
Make sure you book the excursion in advance, some of the most popular ones usually sell out rather quickly.