Take it to the Magistrates/Titans. Accusing someone of a violation of the contract in public is also breaking it. Whether you have evidence or not.
I've no interest in taking it there, more in getting a full account of his accusations so we can continue are arguement on level ground.