mardi 6 novembre 2018

Storing and cataloging large files

I am designing a web API which requires to handle a large number of large files [5-10 GB each] and catalog them based on their content. It also needs to be secure.
I need to store files in a way that they are :
1. Secure.
2. Efficient in performance.
3. Easy to catalog and manage.
While researching I found 2 ways to store these files :
1. Storing directly on a filesystem and referring them with their paths.
PROBLEM - Data is quite insecure compared to Databases.
2. Storing in a Database in form of blobs.
PROBLEM - Database loads the blobs in RAM every time it requires them, which leads to high resource consumption and impacts the performance.
Which should I use? Or is there any other way? Please support your answer with examples.
-Thank You in advance.




Aucun commentaire:

Enregistrer un commentaire