This is Dr. David
it can be normal for you to have swelling or congestion of your spermatic duct to fill with sperm in 2-3 days if you don't masturbate.
this situation is not related to your prostate gland.
congestion of your spermatic duct can also be sometimes called "blue balls" when you can have some fullness of this area.
this is not dangerous or a problem.