Who owns the fence do you know? Does it say anything in your deeds? As you look at the house from the road which side of house is the fence please?
In the absence of anything in your deeds your neighbour would be responsible to the fence to the left.
This is by convention and assuming there is nothing else.
Therefore unless the neighbour can prove otherwise he needs to pay for the repair.
I hope this helps.