Ask an Property Solicitor. Get an Answer ASAP.
No reason, just a flat refusal, he can be a bit obstreperous and he is about 70 years old. Perhaps the scaffolder made him nervous ? He is always moving his car up and down the drive for no obvious reason to us, so I imagine any scaffold would impede this activity.