In short, yes.
Your neighbour can only remove branches which overhang the boundary and encroach on his land. He can only remove back to the boundary line, not beyond it.
It is criminal damage to you property.
Please accept my answer, I am happy to assist further.