it's ok to use your ex-colleagues as your reference

I did it before, it worked well. But you don't need to worry too much about reference at this point of time, focus on your on site interview.

Don't forget to inform your referee in advance.