Interior-Point Methods for Massive Support Vector Machines
Top Cited Papers
- 1 January 2002
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 13 (3) , 783-804
- https://doi.org/10.1137/s1052623400374379
Abstract
We investigate the use of interior-point methods for solving quadratic programming problems with a small number of linear constraints, where the quadratic term consists of a low-rank update to a positive semidefinite matrix. Several formulations of the support vector machine fit into this category. An interesting feature of these particular problems is the volume of data, which can lead to quadratic programs with between 10 and 100 million variables and, if written explicitly, a dense Q matrix. Our code is based on OOQP, an object-oriented interior-point code, with the linear algebra specialized for the support vector machine application. For the targeted massive problems, all of the data is stored out of core and we overlap computation and input/output to reduce overhead. Results are reported for several linear support vector machine formulations demonstrating that the method is reliable and scalable.Keywords
This publication has 17 references indexed in Scilit:
- Advances in Large-Margin ClassifiersPublished by MIT Press ,2000
- Massive data discrimination via linear support vector machinesOptimization Methods and Software, 2000
- Feasible descent algorithms for mixed complementarity problemsMathematical Programming, 1999
- The Linear l1 Estimator and the Huber M-EstimatorSIAM Journal on Optimization, 1998
- A Tutorial on Support Vector Machines for Pattern RecognitionData Mining and Knowledge Discovery, 1998
- Multiple centrality corrections in a primal-dual method for linear programmingComputational Optimization and Applications, 1996
- Nonlinear ProgrammingPublished by Society for Industrial & Applied Mathematics (SIAM) ,1994
- A special newton-type optimization methodOptimization, 1992
- Finite termination of the proximal point algorithmMathematical Programming, 1991
- Robust StatisticsPublished by Wiley ,1981