If you and he are in the exclusive relationship, then while you go for the trip, then he should show he cares about you. He should call you at least once, or should wait for your call. He might not has affair (we have no evident for that), but his behavior showed he doesn't care about you too much. Sorry for being blunt.
Good luck