mardi 7 mai 2019

Deploying Web Crawler Through Web Interface

I've recently built a web scraper that takes in search strings and scraps all related information with reference to the search string. The problem is that the search string has to be hard coded into the scraper.

I was wondering if it's possible to build a web interface for a user to key in a search string in a form and upon submission of the form, the web page will trigger the deployment of a crawler with the search string from the web page.

Been looking at web frameworks like Flask and CherryPy. Just wondering if I'm heading towards the right direction. Thanks in advance for all your advice!




Aucun commentaire:

Enregistrer un commentaire