My first scrapy-grabber
- Create separate python virtual environment:
pyenv install 3.11 --skip-existing
pyenv virtualenv `pyenv latest 3.11` scrapy-grabber
pyenv local scrapy-grabber
pyenv shell scrapy-grabber- Set up packages:
python3.11 -m pip install --upgrade pip
pip install -r requirements.inWe use invoke
It provide next shortcuts:
- inv parse --spider=authors
- inv parse --spider=quotes