Normally, in a non-contested divorce, you and your spouse will stipulate an agreement. After it is signed by a judge it becomes a court order. The judge will sign the stipulation unless it is too unreasonable, against public policy, or affecting the child's rights.
In a contested divorce, the judge will decide these issues for you. Either way, you will have a court order, which you can enforce it by the court's contempt power.
The most complexed issue in your case would child custody and child support. These issues are not carved in stone such that they can be changed anytime until your child reaches 18 or college. Even if you can reach an agreement now, you may still be better off to get an attorney when fighting custody and support issues.