I'm trying to build a web crawler that has to look for websites that are built on Magento. At the moment I am using crawler4j. Is there any way to configure it so it gets a list of domains? Or is there any other crawler that can do this for me?
Aucun commentaire:
Enregistrer un commentaire