A Novel Margin-Based Measure for Directed Hill Climbing Ensemble Pruning
Joint Authors
Li, Yanling
Guo, Huaping
Sun, Fang
Cheng, Jiong
Xu, Mingliang
Source
Mathematical Problems in Engineering
Issue
Vol. 2016, Issue 2016 (31 Dec. 2016), pp.1-11, 11 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2016-07-28
Country of Publication
Egypt
No. of Pages
11
Main Subjects
Abstract EN
Ensemble pruning is a technique to increase ensemble accuracy and reduce its size by choosing a subset of ensemble members to form a subensemble for prediction.
Many ensemble pruning algorithms via directed hill climbing searching policy have been recently proposed.
The key to the success of these algorithms is to construct an effective measure to supervise the search process.
In this paper, we study the importance of individual classifiers with respect to an ensemble using margin theory proposed by Schapire et al.
and obtain that ensemble pruning via directed hill climbing strategy should focus more on examples with small absolute margins as well as classifiers that correctly classify more examples.
Based on this principle, we propose a novel measure called the margin-based measure to explicitly evaluate the importance of individual classifiers.
Our experiments show that using the proposed measure to prune an ensemble leads to significantly better accuracy results compared to other state-of-the-art measures.
American Psychological Association (APA)
Guo, Huaping& Sun, Fang& Cheng, Jiong& Li, Yanling& Xu, Mingliang. 2016. A Novel Margin-Based Measure for Directed Hill Climbing Ensemble Pruning. Mathematical Problems in Engineering،Vol. 2016, no. 2016, pp.1-11.
https://search.emarefa.net/detail/BIM-1112098
Modern Language Association (MLA)
Guo, Huaping…[et al.]. A Novel Margin-Based Measure for Directed Hill Climbing Ensemble Pruning. Mathematical Problems in Engineering No. 2016 (2016), pp.1-11.
https://search.emarefa.net/detail/BIM-1112098
American Medical Association (AMA)
Guo, Huaping& Sun, Fang& Cheng, Jiong& Li, Yanling& Xu, Mingliang. A Novel Margin-Based Measure for Directed Hill Climbing Ensemble Pruning. Mathematical Problems in Engineering. 2016. Vol. 2016, no. 2016, pp.1-11.
https://search.emarefa.net/detail/BIM-1112098
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1112098