I am trying to create a web scraper with Python. This is usually a fairly easy task, but I have run into a few problems.
- I want to have an input list (sys.argv[1]) that will contain numbers to be appended to the end of the url as the search. There should be a for loop that will iterate through each line of the file and then append each line to the end of the url.
- This is where I am running into a problem. I can only run 5 searches without logging in so I need to log into the website before I run the searches. I have attempted multiple login methods and none seem to work consistently.
Any help would be greatly appreciated! Thanks!
Aucun commentaire:
Enregistrer un commentaire