SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine
Joint Authors
Guo, Hua
Wang, Jikui
Ao, Wei
He, Yulin
Source
Computational Intelligence and Neuroscience
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-14, 14 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-06-26
Country of Publication
Egypt
No. of Pages
14
Main Subjects
Abstract EN
A novel ensemble scheme for extreme learning machine (ELM), named Stochastic Gradient Boosting-based Extreme Learning Machine (SGB-ELM), is proposed in this paper.
Instead of incorporating the stochastic gradient boosting method into ELM ensemble procedure primitively, SGB-ELM constructs a sequence of weak ELMs where each individual ELM is trained additively by optimizing the regularized objective.
Specifically, we design an objective function based on the boosting mechanism where a regularization item is introduced simultaneously to alleviate overfitting.
Then the derivation formula aimed at solving the output-layer weights of each weak ELM is determined using the second-order optimization.
As the derivation formula is hard to be analytically calculated and the regularized objective tends to employ simple functions, we take the output-layer weights learned by the current pseudo residuals as an initial heuristic item and thus obtain the optimal output-layer weights by using the derivation formula to update the heuristic item iteratively.
In comparison with several typical ELM ensemble methods, SGB-ELM achieves better generalization performance and predicted robustness, which demonstrates the feasibility and effectiveness of SGB-ELM.
American Psychological Association (APA)
Guo, Hua& Wang, Jikui& Ao, Wei& He, Yulin. 2018. SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine. Computational Intelligence and Neuroscience،Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1130692
Modern Language Association (MLA)
Guo, Hua…[et al.]. SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine. Computational Intelligence and Neuroscience No. 2018 (2018), pp.1-14.
https://search.emarefa.net/detail/BIM-1130692
American Medical Association (AMA)
Guo, Hua& Wang, Jikui& Ao, Wei& He, Yulin. SGB-ELM: An Advanced Stochastic Gradient Boosting-Based Ensemble Scheme for Extreme Learning Machine. Computational Intelligence and Neuroscience. 2018. Vol. 2018, no. 2018, pp.1-14.
https://search.emarefa.net/detail/BIM-1130692
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1130692