ADABOOK & MULTIBOOK: Adaptive Boosting with Chance Correction

    Research output: Contribution to conferencePaper

    Abstract

    There has been considerable interest in boosting and bagging, including the combination of the adaptive techniques of AdaBoost with the random selection with replacement techniques of Bagging. At the same time there has been a revisiting of the way we evaluate, with chance-corrected measures like Kappa, Informedness, Correlation or ROC AUC being advocated. This leads to the question of whether learning algorithms can do better by optimizing an appropriate chance corrected measure. Indeed, it is possible for a weak learner to optimize Accuracy to the detriment of the more reaslistic chance-corrected measures, and when this happens the booster can give up too early. This phenomenon is known to occur with conventional Accuracy-based AdaBoost, and the MultiBoost algorithm has been developed to overcome such problems using restart techniques based on bagging. This paper thus complements the theoretical work showing the necessity of using chance-corrected measures for evaluation, with empirical work showing how use of a chance-corrected measure can improve boosting. We show that the early surrender problem occurs in MultiBoost too, in multiclass situations, so that chance-corrected AdaBook and Multibook can beat standard Multiboost or AdaBoost, and we further identify which chance-corrected measures to use when.

    Original languageEnglish
    Pages349-359
    Number of pages11
    Publication statusPublished - 3 Dec 2013
    EventICINCO 2013 -
    Duration: 29 Jul 2013 → …

    Conference

    ConferenceICINCO 2013
    Period29/07/13 → …

    Keywords

    • Adaboost
    • AUC
    • Bagging
    • Boosting
    • Classifier Fusion
    • Concept Learning
    • Correlation
    • Informedness
    • Kappa
    • Language Technology
    • Machine Learning
    • Markedness
    • Multiboost
    • ROC
    • Signal Processing

    Fingerprint Dive into the research topics of 'ADABOOK & MULTIBOOK: Adaptive Boosting with Chance Correction'. Together they form a unique fingerprint.

  • Cite this

    Powers, D. (2013). ADABOOK & MULTIBOOK: Adaptive Boosting with Chance Correction. 349-359. Paper presented at ICINCO 2013, .