If he is not the admin for both mail servers, he could not fake

Any email has one unique id and the email servers have logs for all recent messages. He can not control both servers without hacking into both of them (his and yours). In the email server logs, there is a timestamp for sending or receiving so it is traceable. Too much work for him if he really want to be clean.