Put things in perspective

1. It's your comfort leve and not anyone else's. And it's based on your own experience. I can say I'm totally comfortable driving in San Francisco and the Bay Area vicinity but that doesn't mean you do. I can see for someone who's not used to driving in large city, it's easy to get lost in SF. Market street is a mess and there are many one ways and no left turn streets as well.
2. When people on this board recommended against your driving in California, they also take into consideration that you have two old parents and 2 small babies, all needing your care without helping you while on the road. Not to mention, 2 weeks of driving with no one sharing your driving responsibility will be exhausting. Maybe it's not a problem for you.
3. Freeways are actually not the hardest part (ok certain portions of them can be confusing such as the 980/580 section in Oakland). The surface streets and also those winding roads to national parks and sea shores (such as Hwy 1) will be hard if you are not used to that type of driving. Parking on 60 degree steep hills in SF and narrow streets can also be challenging in major cities.
Again, if you feel comfortable driving for 2 weeks with little or no help, go for it. I'm just saying putting myself in your shoes I wouldn't.