mardi 1 novembre 2016

Pausing and resuming a self contained scrapy script

I'm running a self contained Scrapy spider, witch lives in a signle .py file. in case of server fail/power outage/any other reason that the script might fail, is there an elegant way to make sure that i will be able to resume a run after recovery?

maybe anything similar to the built in JOBDIR setting?




Aucun commentaire:

Enregistrer un commentaire