on your passport, yes, you'll need to leave US and have your passport stamped at a US Embassy in another country. But it's perfectly ok that you stay in US without the stamp so long as your H-1B is approved.