Successive overrelaxation for support vector machines

Citation
Ol. Mangasarian et Dr. Musicant, Successive overrelaxation for support vector machines, IEEE NEURAL, 10(5), 1999, pp. 1032-1037
Citations number
27
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
IEEE TRANSACTIONS ON NEURAL NETWORKS
ISSN journal
10459227 → ACNP
Volume
10
Issue
5
Year of publication
1999
Pages
1032 - 1037
Database
ISI
SICI code
1045-9227(199909)10:5<1032:SOFSVM>2.0.ZU;2-T
Abstract
Successive overrelaxation (SOR) for symmetric linear complementarity proble ms and quadratic programs is used to train a support vector machine (SVM) f or discriminating between the elements of two massive datasets, each with m illions of points. Because SOR handles one point at a Lime, similar to Plat t's sequential minimal optimization (SMO) algorithm which handles two const raints at a time and Joachims' SVMlight which handles a small number of poi nts at a time, SOB can process very large datasets that need not reside in memory, The algorithm converges linearly to a solution. Encouraging numeric al results are presented on datasets with up to 10 000 000 points. Such mas sive discrimination problems cannot be processed by conventional linear or quadratic programming methods, and to our knowledge have not been solved by other methods. On smaller problems, SOB was faster than SVMlight and compa rable or faster than SMO.