Online Boosting Algorithm Based on Two-Phase SVM Training
Joint Authors
Yugov, Vsevolod
Kumazawa, Itsuo
Source
Issue
Vol. 2012, Issue 2012 (31 Dec. 2012), pp.1-8, 8 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2012-08-14
Country of Publication
Egypt
No. of Pages
8
Main Subjects
Electronic engineering
Information Technology and Computer Science
Abstract EN
We describe and analyze a simple and effective two-step online boosting algorithm that allows us to utilize highly effective gradient descent-based methods developed for online SVM training without the need to fine-tune the kernel parameters, and we show its efficiency by several experiments.
Our method is similar to AdaBoost in that it trains additional classifiers according to the weights provided by previously trained classifiers, but unlike AdaBoost, we utilize hinge-loss rather than exponential loss and modify algorithm for the online setting, allowing for varying number of classifiers.
We show that our theoretical convergence bounds are similar to those of earlier algorithms, while allowing for greater flexibility.
Our approach may also easily incorporate additional nonlinearity in form of Mercer kernels, although our experiments show that this is not necessary for most situations.
The pre-training of the additional classifiers in our algorithms allows for greater accuracy while reducing the times associated with usual kernel-based approaches.
We compare our algorithm to other online training algorithms, and we show, that for most cases with unknown kernel parameters, our algorithm outperforms other algorithms both in runtime and convergence speed.
American Psychological Association (APA)
Yugov, Vsevolod& Kumazawa, Itsuo. 2012. Online Boosting Algorithm Based on Two-Phase SVM Training. ISRN Signal Processing،Vol. 2012, no. 2012, pp.1-8.
https://search.emarefa.net/detail/BIM-494969
Modern Language Association (MLA)
Yugov, Vsevolod& Kumazawa, Itsuo. Online Boosting Algorithm Based on Two-Phase SVM Training. ISRN Signal Processing No. 2012 (2012), pp.1-8.
https://search.emarefa.net/detail/BIM-494969
American Medical Association (AMA)
Yugov, Vsevolod& Kumazawa, Itsuo. Online Boosting Algorithm Based on Two-Phase SVM Training. ISRN Signal Processing. 2012. Vol. 2012, no. 2012, pp.1-8.
https://search.emarefa.net/detail/BIM-494969
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-494969