This project demonstrates how to scrape laptop data from Flipkart's website and store it in a MySQL database.
- Python 3.x
- Required Python packages: requests, pandas, BeautifulSoup, sqlalchemy,mysqlclient
-
Clone the repository:
git clone https://github.com/yourusername/flipkart-scraper-sql.git cd flipkart-scraper-sql
pip install -r requirements.txt
1.) main.py: Main script to initiate the scraping process and database integration.
2.) Web_Scrap.py: Contains the FlipkartScraper class for scraping laptop data from Flipkart.
3.) SQL.py: Contains the SQLDatabase class for managing the MySQL database operations.
4.) requirements.txt: List of required Python packages.
Update the configuration details (username, password, host, port, database name) in sql_database.py to match your MySQL database settings.