A New Interpretation of the Weighted Kappa Coefficients

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Reliability and agreement studies are of paramount importance. They do contribute to the quality of studies by providing information about the amount of error inherent to any diagnosis, score or measurement. Guidelines for reporting reliability and agreement studies were recently provided. While the use of the kappa-like family is advised for categorical and ordinal scales, no further guideline in the choice of a weighting scheme is given. In the present paper, a new simple and practical interpretation of the linear- and quadratic-weighted kappa coefficients is given. This will help researchers in motivating their choice of a weighting scheme.
Original languageEnglish
Pages (from-to)399-410
Number of pages12
JournalPsychometrika
Volume81
Issue number2
DOIs
Publication statusPublished - Jun 2016

Keywords

  • agreement
  • reliability
  • ordinal scale
  • linear
  • quadratic
  • COHENS KAPPA
  • HIGH AGREEMENT
  • PREVALENCE
  • DEPENDENCE
  • MODEL

Cite this