My 2002 Sienna van had a similar issue, particularly when it went downhill on a hard brake. Not sure what had caused this but I figured the vehicle was due for a brake change. So I went to Sears and had the front brake pads replaced and rotors resurfaced. The problem seems to be gone.