Is it a truthful representation of what you told him?
So some of what he is saying is untrue?
Or not accurately what you said to him?
There isn't anything that can be done about the breach of confidence. It is morally wrong but no more than that. Certainly it is not legally actionable.
If he is saying things that are wildly at odds with what you told him then that might be actionable. I suppose arguably that could be a defamation. Whether or not you would want to sue is another matter of course.
If you tell me how badly wrong they are then I might be able to offer more.
Can I clarify anything for you?