samedi 20 juin 2020

Web scraping, beautiful soup and link which doesn't work

I have a problem with scraping because the agent changed its website. And when I make

page = driver.get(link)
page = driver.page_source
page = BeautifulSoup(page, "html.parser")

The link which I want to get doesn't work (server error). This link is new and I can obtain it but when I use it I have an error.

I can enter this link in other way (by categories and getting href) but in this way page = driver.get(link) doesn't work.

What can I do in this situation?




Aucun commentaire:

Enregistrer un commentaire