Robust linear and support vector regression
- 1 September 2000
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 22 (9) , 950-955
- https://doi.org/10.1109/34.877518
Abstract
The robust Huber M-estimator, a differentiable cost function that is quadratic for small errors and linear otherwise, is modeled exactly, in the original primal space of the problem, by an easily solvable simple convex quadratic program for both linear and nonlinear support vector estimators. Previous models were significantly more complex or formulated in the dual space and most involved specialized numerical algorithms for solving the robust Huber linear estimator. Numerical test comparisons with these algorithms indicate the computational effectiveness of the new quadratic programming model for both linear and nonlinear support vector problems. Results are shown on problems with as many as 20000 data points, with considerably faster running times on larger problems.Keywords
This publication has 15 references indexed in Scilit:
- Multisurface proximal support vector machine classification via generalized eigenvaluesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Linear programs for automatic accuracy control in regressionPublished by Institution of Engineering and Technology (IET) ,1999
- The Linear l1 Estimator and the Huber M-EstimatorSIAM Journal on Optimization, 1998
- Improved Generalization via Tolerant TrainingJournal of Optimization Theory and Applications, 1998
- The Nature of Statistical Learning TheoryPublished by Springer Nature ,1995
- Nonlinear ProgrammingPublished by Society for Industrial & Applied Mathematics (SIAM) ,1994
- Finite alogorithms for robust linear regressionBIT Numerical Mathematics, 1990
- Robust StatisticsPublished by Wiley ,1981
- Nonlinear Perturbation of Linear ProgramsSIAM Journal on Control and Optimization, 1979
- Robust regression using iteratively reweighted least-squaresCommunications in Statistics - Theory and Methods, 1977