Thank you for your response.
I do have to say that when it is the mother's time with your son then she can technically leave him with whom ever she wants too to care for him. They do not have to have PR for him and they do not need to be registered childminders.
That being said, if there was a child protection risk in respect of any of these individuals then you would need to act to safeguard your son. If you heard something concerning in nature, such as drugs, alcohol misuse, violence etc then you could try talking to the mother and see what she says, and if there was no reasonable explanation then you should report matters to your local children social care so that they can investigate matters.
I can fully understand that if your son is being 'passed from pillar to post' all of the time that he is with his mother then this would be concerning to you, especially if you are able to provide the care that he needs. You could seek to return matters back to court on this basis.
You would have to attempt mediation first to see if matters could be resolved that way. If mediation doesnt lead to a resolution then you can apply to court. If you do have to take this route, so as to ensure that you do not look like you are just being difficult and trying to limit the mothers time (which she is bound to argue) get your evidence together - by way of a list detailing all of the times that you are aware that he has been left elsewhere. This would help ensure that you are acting in your son's best interests and not just being difficult with the mother.
Please kindly remember to positively star rate my service so that credit is received for helping you today. Your question remains open when you leave positive feedback and I can answer your follow up questions for free.