You and the builder can report this to the police as harassment.
You are entitled to to carry out the works on your land. in order to stop you/your builder would be by injunction. your neighbour would have to go to court for an order and claim the works cause nuisance. the neighbour would have to claim that the works are causing unreasonable interference with the neighbour's use and enjoyment of their land.