Start Submission Become a Reviewer

Reading: Performance of LASSO and Elastic net estimators in Misspecified Linear Regression Model

Download

A- A+
Alt. Display

Research Articles

Performance of LASSO and Elastic net estimators in Misspecified Linear Regression Model

Authors:

M. Kayanan ,

University of Peradeniya, Peradeniya, LK
About M.

Postgraduate Institute of Science

 

Department of Physical Science, Vavuniya Campus of the University of Jaffna, Vavuniya

X close

P. Wijekoon

University of Peradeniya, Peradeniya, LK
About P.
Department of Statistics and Computer Science, Faculty of Science,
X close

Abstract

Ridge Estimator (RE) has been used as an alternative estimator for Ordinary Least Squared Estimator (OLSE) to handle multicollinearity problem in the linear regression model. However, it introduces heavy bias when the number of predictors is high, and it may shrink irrelevant regression coefficients, but they are still in the model. Least Absolute Shrinkage and Selection Operator (LASSO) and Elastic net (Enet) estimator have been used to make the variable selection and shrinking the regression coefficients simultaneously. Further, the model misspecification due to excluding relevant explanatory variable in the linear regression model is considered as a severe problem in statistical research, and it will lead to bias and inconsistent parameter estimation. The performance of RE, LASSO and Enet estimators under the correctly specified regression model was well studied in the literature. This study intends to compare the performance of RE, LASSO and Enet estimators in the misspecified regression model using Root Mean Square Error (RMSE) criterion. A Monte-Carlo simulation study was used to study the performance of the estimators. In addition to that, a real-world example was employed to support the results. The analysis revealed that Enet outperformed RE and LASSO in both correctly specified model and misspecified regression model.
How to Cite: Kayanan, M., & Wijekoon, P. (2019). Performance of LASSO and Elastic net estimators in Misspecified Linear Regression Model. Ceylon Journal of Science, 48(3), 293–299. DOI: http://doi.org/10.4038/cjs.v48i3.7654
Published on 16 Sep 2019.
Peer Reviewed

Downloads

  • PDF (EN)

    comments powered by Disqus