Have you ever thought your own problems? I think I can tell some, hopefully I am biased.
I suggest you to talk to someone who knows your situation well, and really want to help you out, not here. Remember, this is your own business, not someone else. If someone says something that sounds very supportive and helpful, remember that he/she (even your parents, other relatives) is not responsible for any adversary outcome. If suffer, you would suffer. Try to change yourself, do not try to change others first. Try not to center yourself on everything. After your marriage, and having a baby, you are no longer a single person, you have your own commitment, keep your promise, fullfill your own commitment. Fighting/argument (not physical or verbal violence or abuse ) is a normal part of a normal marrital life. Do not imagine any unpractical marital scenario.
Do not always listen to your parents or your siblings, they might mess everythin up.
Separation/divoice is easy, but it is often the biginning of bigger troubles, and it is also irresponsible to your kid, your parents, relatives, and your hu*****and.
Finally, after your careful consultation for a few months, if you still think your husand is a pound of trash, and a wise man also agree with you, then get rid of it.