Serritor 1.3.0
This release includes new features, improvements and changes to the existing API.
New features in a nutshell:
- Crawl domains: they specify the domains in which crawling is allowed
- Crawl delay mechanisms: these can be used to determine the delay between each request
- Url finder: it can be used to find URLs in HTML sources using regular expressions
Please check the Wiki for more information.