mercredi 20 décembre 2017

Web scrape with python | Limited objects

I'm trying to get data from a website that uses pc parts, and i have this link taht have have over 3500 parts on that page, the problem is that if i use the clean link: http://ift.tt/2oZXLT8

it only get the data that is there before i scrole down and it loads new items.

So i took the link edited like this: http://ift.tt/2Dj5Bue

Now it gets all the info from over 1000 products but i cant go over that because the script just dont want to work, i dont get an error or anything. BTW, i only get the things on sale so its not that much data

I want a way to go trough the hole page without having too write the limit to how many products i want to go trough.




Aucun commentaire:

Enregistrer un commentaire