Combining predictions in pairwise classification: An optimal adaptive voting strategy and its relation to weighted voting

Eyke Huellermeier*, Stijn Vanderlooy

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    87 Citations (Web of Science)

    Abstract

    Weighted voting is the commonly used strategy for combining predictions in pairwise classification. Even though it shows good classification performance in practice, it is often criticized for lacking a sound theoretical justification. In this paper, we study the problem of combining predictions within a formal framework of label ranking and, under some model assumptions, derive a generalized voting strategy in which predictions are properly adapted according to the strengths of the corresponding base classifiers. We call this strategy adaptive voting and show that it is optimal in the sense of yielding a MAP prediction of the class label of a test instance. Moreover, we offer a theoretical justification for weighted voting by showing that it yields a good approximation of the optimal adaptive voting prediction. This result is further corroborated by empirical evidence from experiments with real and synthetic data sets showing that, even though adaptive voting is sometimes able to achieve consistent improvements, weighted voting is in general quite competitive, all the more in cases where the aforementioned model assumptions underlying adaptive voting are not met. In this sense, weighted voting appears to be a more robust aggregation strategy. (C) 2009 Elsevier Ltd. All rights reserved.

    Original languageEnglish
    Pages (from-to)128-142
    Number of pages15
    JournalPattern Recognition
    Volume43
    Issue number1
    DOIs
    Publication statusPublished - Jan 2010

    Keywords

    • Learning by pairwise comparison
    • Label ranking
    • Aggregation strategies
    • Classifier combination
    • Weighted voting
    • MAP prediction
    • CLASSIFIERS

    Cite this