Does the lease have any stipulation on opening times or say that the owners have the right to determine when you should be open?
As such the owners cannot dictate when you open or close provided you remain within the terms of the lease.
In most leases there is a clause which states that having granted the lease the owners must give you quiet enjoyment and interfere with what they have granted you.
You need to check that you have such a clause in your lease, most do, and if so they are in breach of it and you can use this to stop them pestering you
Please reply if you need to.