Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Kao, W.-C.
Right arrow Articles by Lin, C.-J.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Kao, W.-C.
Right arrow Articles by Lin, C.-J.
(Neural Computation. 2004;16:1689-1704.)
© 2004 The MIT Press


Letter

Decomposition Methods for Linear Support Vector Machines

Wei-Chun Kao

b89106{at}csie.ntu.edu.tw, Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan

Kai-Min Chung

b88061{at}csie.ntu.edu.tw, Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan

Chia-Liang Sun

b88047{at}csie.ntu.edu.tw, Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan

Chih-Jen Lin

cjlin{at}csie.ntu.edu.tw, Department of Computer Science and Information Engineering, National Taiwan University, Taipei 106, Taiwan

In this letter, we show that decomposition methods with alpha seeding are extremely useful for solving a sequence of linear support vector machines (SVMs) with more data than attributes. This strategy is motivated by Keerthi and Lin (2003), who proved that for an SVM with data not linearly separable, after C is large enough, the dual solutions have the same free and bounded components. We explain why a direct use of decomposition methods for linear SVMs is sometimes very slow and then analyze why alpha seeding is much more effective for linear than nonlinear SVMs. We also conduct comparisons with other methods that are efficient for linear SVMs and demonstrate the effectiveness of alpha seeding techniques in model selection.







HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2004 by The MIT Press.