You can get the deeds to your property from the land registry by following this link. It will cost you £3 for each of the deed and the plan. They arrive in seconds.
There is no legal convention where the property on one side owns one boundary and the property on the other side owns the other boundary. It is a legal myth.
If the deeds do not have any mention of who owns which boundary and there are no T marks on the title plan indicating that the boundary is your responsibility, then the boundary is jointly owned. In that case, unless the neighbour consented to you replacing the fence on the boundary, (he is just as able to let it fall down as you are to want it looking nice) then you cannot replace the fence without his consent unless you offset it slightly so that it is completely on your side. It would mean erecting the fence so that the wood panels did not go over the centre line of the existing posts.
So, if it is a joint fence, even though you paid for the panels, you cannot stop the neighbour putting whatever he likes up against his side.
I can see the problem here. You have spent a considerable amount of money on putting up expensive and really nice looking fence panels only to now have this brushwood fencing on his side, looking a mess. From his side, all he will see of course is the cheap brushwood whereas from your side you will see the brushwood backing your beautiful fence. Hence, I can see exactly why this is so annoying for you.
Unfortunately, there is little that you can do about it. If the neighbour simply refuses to move the fence, you would be faced with making an application to court for an injunction to remove the brushwood which is not going to be cheap. It is also not going to be risk-free because it’s highly likely that a judge would come to the conclusion, as I have, that he has as much right to put his brushwood fencing in this position as you do to put your nice looking fence.
If the fence is shown to be your responsibility in the deeds, then the situation would be different but if he resolutely refuses to remove it, you are still faced with a court application.
Can I clarify anything else for you?
Please rate the service positive. It is an important part of the process by which experts get paid. It does not cost you anything but helps us greatly.