GitHub - GNDG/IndeedScrapper

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 17 Commits
indeed		indeed
.gitignore		.gitignore
LICENSE		LICENSE
README		README
scrapy.cfg		scrapy.cfg

Repository files navigation

Spider to use with the Scrapy web crawling and scraping Python framework. Scrapes job listings from Indeed.com and stores in a MySQL DB
http://scrapy.org/


Requires
---------------
scrapy
pymongo


Usage
---------------
cp settings.py.example settings.py
edit settings.py
> scrapy crawl indeed --logfile=crawl.log