If I am the one who is making the U-turn

I would be very careful watching other cars since the other one has a hard time predict what you are trying to do, no matter who has the right of the way. Realistically, nobody has the right of the way, which is why we have defensive driving.