maybe you go for 1 h, and then your husband goes for 1 h?
Once my boss had such an adult only party, I went to there for one hour. Then I went home, and my hu*****and went there for 1 hour. If you do so, your family may still be together to celebrate the beginning (midnight) of the New Year.