You will need the dad's agreement and signature to apply

passport for the baby. Even if you have custody, the dad has visitation rights. If he is a jerk, he can request you to surrender the baby's passport if there is one, and he can put travel restriction on the baby. All he needs to say is that he suspects that you might kidnap the baby to overseas.