Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resume scraping #3

Open
philogb opened this issue Aug 7, 2013 · 1 comment
Open

Resume scraping #3

philogb opened this issue Aug 7, 2013 · 1 comment

Comments

@philogb
Copy link

philogb commented Aug 7, 2013

I'm trying to get all messages from a mailing list, but sometimes in the middle of the process I get a timeout. How hard would it be for the scraper to have an option to resume from last error? I mean, some of the files are there already, no need to refetch them.

@philgyford
Copy link
Owner

I'm sure it's possible, but I don't know how easy it would be. I haven't looked at the code for years myself I'm afraid.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants