lundi 8 novembre 2021

502/504 errors while scrapping site [closed]

through scraping site, sometimes (1 of 1000 pages) i have 502/504 or empty body response.(I do request, if had invalid response, do it again after 1 minute, and the second request is also invalid)


if I do the same request from browser I see that page is valid


when I made more sleep places, there are fewer errors, but they have not disappeared


can you tell me what it might be

Aucun commentaire:

Enregistrer un commentaire