Start to collect evidence...

It seems the fight/dispute will be inevitable. I think you need to collect some evidences calmly/secretly. How do you know you have over-half workload? Is there anything measurable?

It will be hard to use your co-workers as witness but you need to manage to get some objective opinions from them,w hich will be eventually used to support your case.

Good luck!