lundi 27 janvier 2020

Scraping methods, is there any difference?

im currently on this forum because i have been dealing with a huge problem lately, as a company that sell stuff we usually do web-scraping for the competition, the thing is that the current host that we're using the php-scraping has 4 gb ram with CPU: E5-4620 2.2 Ghz, when we try to scrape all categories of a website at once it says timeout after a few minutes and it fails... so my doubt here is

"Will web-scraping be faster and could handle the requests with a better hosting? like this one:

Intel Xeon E-2186G processor (six physical 3.8ghz cores + hyperthreading + turbo->4.7ghz 64 GB DDR4-2666 ECC memory 960 GB SSD 60000 GB of bandwidth transfer 1 GB download/upload internet connection.

Thanks in advance for the help,




Aucun commentaire:

Enregistrer un commentaire