I would do all three things: talk to other parents, request video (If they have it) and move to a different school. The first two things will provide some new information to help you check if your guts feeling is reasonable. You will need those guts feeling in the future too.
Yes, Trust your instinct. That means something is wrong. We had young male day care teacher, and we all were comfortable with him. I believe a mother's instinct, do not put your kid in any risk, especially this kind.