Ask an Property Solicitor. Get an Answer ASAP.
You are right, no party wall notice was served as they are slightly in from the party fence wall on their side. the original party fence wall is still in place and the fence and trees are on our side of the boundary
Thank you for your answer. Following the amount of abuse we have had from our neighbour today you have given us peace of mind.