Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supplement for ridge and LASSO regression #144

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions penalized_regression
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
## Penalized Regression: Ridge and LASSO

In the lecture on Regularized Regression under the Practical Machine Learning course of Coursera's Data Science Specialization, we were introduced to the theoretical concepts of two penalized regression models: ridge and LASSO (Least Absolute Shrinkage and Selection Operator).

**This is an attempt to:**

1. Support that theory with a practical example using the ``mtcars`` dataset and the ``caret package`` to obtain a visual understanding of the concept of shrinking coefficients.

2. Compare goodness of fit on training data and prediction accuracy on test data across linear model (LM), ridge, and LASSO.

3. Explore the goodness of fit and prediction accuracy implications of feature selection in LM using LASSO.

[github repo for content on ridge and LASSO](https://github.com/kumar-navya/DS_toshare/tree/master/Supplement_Penalized_Regression)