Skip to content

Gaurav0807/Web_Scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 

Repository files navigation

Flipkart Scraper and SQL Database Integration

Architecture

This project demonstrates how to scrape laptop data from Flipkart's website and store it in a MySQL database.

Prerequisites

  • Python 3.x
  • Required Python packages: requests, pandas, BeautifulSoup, sqlalchemy,mysqlclient

Usage

  1. Clone the repository:

    git clone https://github.com/yourusername/flipkart-scraper-sql.git
    cd flipkart-scraper-sql
    
    

Install the required packages:

pip install -r requirements.txt

Files

1.)  main.py: Main script to initiate the scraping process and database integration.
2.) Web_Scrap.py: Contains the FlipkartScraper class for scraping laptop data from Flipkart.
3.) SQL.py: Contains the SQLDatabase class for managing the MySQL database operations.
4.) requirements.txt: List of required Python packages.

Configuration

Update the configuration details (username, password, host, port, database name) in sql_database.py to match your MySQL database settings.

Output

output

About

Web Scraping Project

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages