I went to Canada with my Green Card only in 2000, and I had no problems at all.
If you are citizen, you should bring your passport, right? otherwise who knows you are US citizen or not?
If you are citizen, you should bring your passport, right? otherwise who knows you are US citizen or not?