So, I’m currently working on a web scraper/crawler using pyqt4 (QNetworkAccessManager) and I’m getting some weird response.
I am receiving an empty html with no error in an incremental way. So, the first response works, then 2 blank html then a response then 4 blanks etc.
Is it possible that the website uses some defense mechanism? (I am making those requests with random interval from 10 sec to 30)
Thank you for your time
Aucun commentaire:
Enregistrer un commentaire