How to secure uploaded files on the server?

I have uploaded files stored on the public_html directory on my server and allowed any user to access any file. But I don't want someone to just brute-force and scrap all the uploaded files. How can I prevent this from happening?

My folder structure is like this: public_html/attachments/shops/products/{time().FILE_EXTENSION}