CI/DD for machine learning using MLRun

This code is part of the assignment for the course "Software Tools and Techniques for AI" @IITGN.

Assignment Report showing all the steps from installation of MLRun on arch linux(Endeavor OS) to deploying to docker hub. It also includes debugging steps for some of the errors that were encountered.

Using MLRun to create a CI/CD workflow for Breast Cancer Classification using Random Forests on various parameters.

The workflow was divides into 3 steps:

1. Data prep Container
2. Trainer Container: Trained the RandomForest Classifier model on the data from the previous step. Used a permutation of different hyperparameters for n_estimators and max_depth.
3. Deployement Container: Created the image and pushed it to docker hub.

Image showing the MLRun Workflow

Data Prep Artificat (dataframe)

Results

Confusion matrix

Feature importance