Thanks for your question. I will try to help.
If he is not occupying the premises at all then presumably no notice needs to be served to terminate his occupation (i.e. because he is not occupying it).
If you are the registered proprietor of the property then you are the owner and it would be sensible for you to protect the asset by arranging buildings insurance for it. If there is no buildings insurance and damage occurs then you would have to pay to have it repaired privately if you wished to maintain its value and your ability to perhaps sell it in the future.
Additionally, if there is a mortgage on the property which you took over (perhaps because you remortgaged it when it was transferred to you) then there will be a mortgage condition that you must insure the property. If there is a mortgage and you have not arranged insurance then you would be in breach of the mortgage conditions, which potentially exposes you to liability to the mortgage lender if the property suffers damage and they suffer loss. If you are the owner/registered proprietor of the property then I would arrange insurance and certainly if there is a mortgage on the property (in which case you should do it as a matter of urgency).
If the council tax has been changed to your name and is not being paid then you also need to check with the council. If it is in your name and not being paid then the council may attempt to get judgement against you for the debt. If they got judgement then this would affect your ability to get a mortgage in the future and would detrimentally affect your credit rating.
The position is the same with the utility bills, although if no one is occupying then presumably there are not considerably charges.
My goal is to provide you with a good service. If you feel you have received anything less, please reply back. Please remember to leave positive feedback using the stars at the top of the page.