I will look into this and respond in the morning.
Can the neighbour prove that the fence is his? it is rarely the case that the deeds identify who has the responsibility for a particular boundary fence.
Rarely the deeds state who has responsibility for the boundary fence. if not, then how can the neighbour establish it is his fence.
How long has the neighbour lived at the property?