This repository has been archived by the owner on Aug 12, 2020. It is now read-only.
Export from database URLs
Combines the SMT Drupal database with scrapy framework to feed URLs from the database directly to scrapy's start_urls