Skip to main navigation Skip to search Skip to main content

Shapley-Value based Inductive Conformal Prediction

  • William Lopez Jaramillo*
  • , Evgueni Smirnov
  • , L Carlsson
  • , Z Luo
  • , G Cherubin
  • , KA Nguyen
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference article in proceeding › Academic › peer-review

23 Downloads (Pure)

Abstract

Shapley values of individual instances were recently proposed for the problem of data valuation. They were defined as the average marginal instance contributions to the performance of a given predictor. In this paper we propose to use Shapley values of individual instances as conformity scores. To compute these values efficiently and exactly we employ a standard algorithm based on nearest neighbor classification and propose a variant of this algorithm for clustered data. Both variants are used for computing Shapley conformity scores for inductive conformal predictors. The experiments show that the Shapley-value conformity scores result in smaller prediction sets for significance level epsilon <= 0:1 compared with those produced by standard conformity scores (i.e. similarity between true and predicted output values).
Original languageEnglish
Title of host publicationCONFORMAL AND PROBABILISTIC PREDICTION AND APPLICATIONS, VOL 152
EditorsL Carlsson, Z Luo, G Cherubin, KA Nguyen
PublisherJMLR - Journal of Machine Learning Research
Pages52-71
Number of pages20
Volume152
Publication statusPublished - 2021
Event10th Conformal and Probabilistic Prediction and Applications 2021 - Online, Centre for Reliable Machine Learning, Egham, United Kingdom
Duration: 8 Sept 2021 → 10 Sept 2021
https://cml.rhul.ac.uk/copa2021/

Publication series

SeriesProceedings of Machine Learning Research
Volume152
ISSN2640-3498

Conference

Conference10th Conformal and Probabilistic Prediction and Applications 2021
Abbreviated titleCOPA 2021
Country/TerritoryUnited Kingdom
CityEgham
Period8/09/21 → 10/09/21
Internet address

Keywords

  • Inductive Conformal Prediction
  • Shapley values
  • Conformity Scores

Fingerprint

Dive into the research topics of 'Shapley-Value based Inductive Conformal Prediction'. Together they form a unique fingerprint.

Cite this