My client wants a crawler written to crawl several websites on periodic basis. He does not have a priority for language but as I only work in PHP I am looking for a efficient web crawler script (as a base) which would help me doing this job. Anyways is it a good idea to choose a pre-built script or is it better to write our own custom script? This client has several web crawling jobs (and he already has hired 6 developers at Upwork!) so I want to come up with the best of solutions so it could help me and him in long run. Any idea?
Aucun commentaire:
Enregistrer un commentaire