Linear regression via elastic net: non-enumerative leave-one-out verification of feature selection
Book chapter
Chernousova, E., Razin, N., Krasotkina, O., Mottl, V. and Windridge, D. 2014. Linear regression via elastic net: non-enumerative leave-one-out verification of feature selection. in: Aleskerov, F., Goldengorin, B. and Pardalos, P. (ed.) Clusters, Orders, and Trees: Methods and Applications: In Honor of Boris Mirkin's 70th Birthday New York Springer.
Chapter title | Linear regression via elastic net: non-enumerative leave-one-out verification of feature selection |
---|---|
Authors | Chernousova, E., Razin, N., Krasotkina, O., Mottl, V. and Windridge, D. |
Abstract | The feature-selective non-quadratic Elastic Net criterion of regression estimation is completely determined by two numerical regularization parameters which penalize, respectively, the squared and absolute values of the regression coefficients under estimation. It is an inherent property of the minimum of the Elastic Net that the values of regularization parameters completely determine a partition of the variable set into three subsets of negative, positive, and strictly zero values, so that the former two subsets and the latter subset are, respectively, associated with “informative” and “redundant” features. We propose in this paper to treat this partition as a secondary structural parameter to be verified by leave-one-out cross validation. Once the partitioning is fixed, we show that there exists a non-enumerative method for computing the leave-one-out error rate, thus enabling an evaluation of model generality in order to tune the structural parameters without the necessity of multiple training repetitions. |
Book title | Clusters, Orders, and Trees: Methods and Applications: In Honor of Boris Mirkin's 70th Birthday |
Editors | Aleskerov, F., Goldengorin, B. and Pardalos, P. |
Publisher | Springer |
Place of publication | New York |
Series | Springer Optimization and Its Applications |
ISBN | |
Hardcover | 9781493907410 |
Electronic | 9781493907427 |
ISSN | 1931-6828 |
Publication dates | |
01 May 2014 | |
Publication process dates | |
Deposited | 22 Apr 2016 |
Accepted | 01 Jan 2014 |
Output status | Published |
Digital Object Identifier (DOI) | https://doi.org/10.1007/978-1-4939-0742-7_22 |
Scopus EID | 2-s2.0-85040861947 |
Language | English |
https://repository.mdx.ac.uk/item/864v8
Restricted files
Accepted author manuscript
68
total views0
total downloads0
views this month0
downloads this month