Learn Before
Advantages and Bias Correction in Elastic Net Regression
LASSO uses an penalty and can encounter two important limitations: when the number of predictors exceeds the number of examples, it selects at most as many predictors as there are examples before saturating; and among highly correlated predictors, it tends to select one while excluding the others. Elastic net combines the LASSO penalty with a quadratic penalty, helping address these limitations. When its component is positive, the objective is strongly convex and has a unique minimum. LASSO and ridge regression are special cases of elastic net. A naive elastic-net procedure first estimates ridge coefficients for a fixed and then applies LASSO-type shrinkage, causing double shrinkage that can increase bias and impair prediction. Rescaling the resulting coefficients by corrects this additional shrinkage.

0
1
Contributors are:
Who are from:
Tags
Data Science