Silhouettes and Quasi Residual Plots for Neural Nets and Tree-based Classifiers

Jakob Raymaekers, Peter J. Rousseeuw*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Classification by neural nets and by tree-based methods are powerful tools of machine learning. There exist interesting visualizations of the inner workings of these and other classifiers. Here we pursue a different goal, which is to visualize the cases being classified, either in training data or in test data. An important aspect is whether a case has been classified to its given class (label) or whether the classifier wants to assign it to a different class. This is reflected in the (conditional and posterior) probability of the alternative class (PAC). A high PAC indicates label bias, that is, the possibility that the case was mislabeled. The PAC is used to construct a silhouette plot which is similar in spirit to the silhouette plot for cluster analysis. The average silhouette width can be used to compare different classifications of the same dataset. We will also draw quasi residual plots of the PAC versus a data feature, which may lead to more insight in the data. One of these data features is how far each case lies from its given class. The graphical displays are illustrated and interpreted on datasets containing images, mixed features, and tweets. Supplementary materials for this article are available online.

Original languageEnglish
Pages (from-to)1332-1343
Number of pages12
JournalJournal of Computational and Graphical Statistics
Volume31
Issue number4
Early online date4 Apr 2022
DOIs
Publication statusPublished - 2 Oct 2022

Keywords

  • Image data
  • Label bias
  • Mislabeling
  • Probability of alternative class
  • Supervised classification
  • Text analysis

Fingerprint

Dive into the research topics of 'Silhouettes and Quasi Residual Plots for Neural Nets and Tree-based Classifiers'. Together they form a unique fingerprint.

Cite this