SCRAPING

A Repository containing various projects related to data scraping

Language Used: Python Package: BeautifulSoup //for data scraping Pandas //for writing to csv files

CREATE A VIRTUAL ENVIRONMENT

virtualenv -p python3 VENV_NAME

ACTIVATE

windows: VENV_NAME/Scripts/activate

linux: source VENV_NAME/bin/activate

macos: source VENV_NAME/bin/activate

INSTALL REQUIREMENTS (Requires pip: sudo apt-get install pip)

pip install -r requirements.txt

SELENIUM WEB DRIVERS

https://github.com/mozilla/geckodriver/releases/tag/v0.21.0