You can sue anyone. But do you have proof?

Your wife's words are not very strong in the court. You have to have some convinincing evidence, Installing video cam is a goo idea. At least you can use cellphone to record the conversation if it every happens again.