Supplement for ridge and LASSO regression #144
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In the lecture on Regularized Regression under the Practical Machine Learning course of Coursera's Data Science Specialization, we were introduced to the theoretical concepts of two penalized regression models: ridge and LASSO (Least Absolute Shrinkage and Selection Operator).
This is an attempt to:
Support that theory with a practical example using the mtcars dataset and the caret package to obtain a visual understanding of the concept of shrinking coefficients.
Compare goodness of fit on training data and prediction accuracy on test data across linear model (LM), ridge, and LASSO.
Explore the goodness of fit and prediction accuracy implications of feature selection in LM using LASSO.
github repo with content for ridge and LASSO