let's party --- party right away
let's go party --- go somewhere and party
let's go to a(the) party --- go to a specific party
"let's go to party" still is not quite there....