Skip to content

Crawl data from the web, preprocess the data and apply it with machine learning models

Notifications You must be signed in to change notification settings

duythanh22/web-crawler-and-machine-learning

Repository files navigation

Crawl data from the web, preprocess the data and apply it with machine learning models

Step 1:

  • Crawler: Use Selenium framework to collect data from the web

    Collect data on information about parameters of old cars that are suitable for the problem

Step 2: Preprocessing data

  • Preprocessing includes: data cleaning, empty value handling, exception value handling

Step 3: Explore data

  • Explore data: Statistics describe data, visualize data

Step 4: Modeling

  • Standardize the data to match the selected models (Linear regression, Random forest regression), training models, evaluation and testing

Step 5: Deploy with web

  • Use Flask framework to build a simple website for used car price prediction model

By: Do Duy Thanh, ICTU

About

Crawl data from the web, preprocess the data and apply it with machine learning models

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages