An Ensemble of Optimal Trees for Class Membership probability estimation

Zardad Khan, Asma Gul, Osama Mahmoud, Miftahuddin Miftahuddin, Aris Perperoglou, Werner Adler, Berthold Lausen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Citations (Scopus)


Machine learning methods can be used for estimating the class membership probability of an observation. We propose an ensemble of optimal trees in terms of their predictive performance. This ensemble is formed by selecting the best trees from a large initial set of trees grown by random forest. A proportion of trees is selected on the basis of their individual predictive performance on out of-bag observations. The selected trees are further assessed for their collective performance on an independent training data set. This is done by adding the trees one by one starting from the highest predictive tree. A tree is selected for the final ensemble if it increases the predictive performance of the previously combined trees. The proposed method is compared with probability estimation tree, random forest and node harvest on a number of bench mark problems using Brier score as a performance measure. In addition to reducing the number of trees in the ensemble, our method gives better results in most of the cases. The results are supported by a simulation study.

Original languageEnglish
Title of host publicationAnalysis of Large and Complex Data
EditorsAdalbert F.X. Wilhelm, Hans A. Kestler
PublisherKluwer Academic Publishers
Number of pages15
ISBN (Print)9783319252247
Publication statusPublished - 2016
Externally publishedYes
Event2nd European Conference on Data Analysis, ECDA 2014 - Bremen, Germany
Duration: Jul 2 2014Jul 4 2014

Publication series

NameStudies in Classification, Data Analysis, and Knowledge Organization
ISSN (Print)1431-8814


Conference2nd European Conference on Data Analysis, ECDA 2014

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems
  • Information Systems and Management
  • Analysis


Dive into the research topics of 'An Ensemble of Optimal Trees for Class Membership probability estimation'. Together they form a unique fingerprint.

Cite this