I'm trying to create a web crawler that will generate links given a certain keyword. Like if I tell it to generate links with https://someimage.com/ any links with that in it will be selected. I need this because I can't just look in https://someimage.com/ because there is an XML file error. To not get that error, I need to get that link, then write the GUID of that image, for example https://someimage.com/assets/2c/59/2c59628d-4aa7-4584-96c1-0e8e7b8995d3.jpg is the whole thing. I can't get all these links manually due to there being thousands of links that I need to download, also I don't know each link's adresse. I know this is a long shot but I figured I'd ask anyway.
Aucun commentaire:
Enregistrer un commentaire