jeudi 23 avril 2015

Best Scraper for any site [on hold]

I'm a web developer and need to scrap websites for information. I am looking to scrap dynamic sites, encrypted sites, download files and I have a lot of functionality in the future.

I have looked at few solutions:

  • jsdom - nodejs

  • Selenium - java

  • cheerio - nodejs (Read an Article saying jsdom is more powerful so
    wont be using cheerio)

I prefer the scraper to be text base and not open a browser to keep performance fast.

I need to know what is the best method to scrap all types of sites and why its the best method.




Aucun commentaire:

Enregistrer un commentaire