If departing from US/Canada and arriving to Canada/US without transit via a third country, passport is not a must for a US/Canadian citizen/US-GC holder.
If entering from another country, say Japan or France, even a US citizen needs US passport to enter US, a Canadian citizen needs Canadian passport to enter Canada.