Predicting Recidivism Risk Meets AI Act

Gijs van Dijck*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

380 Downloads (Pure)

Abstract

Quantitative recidivism risk assessment can be used at the pretrial detention, trial, sentencing, and / or parole stage in the justice system. It has been criticized for what is measured, whether the predictions are more accurate than those made by humans, whether it creates or increases inequality and discrimination, and whether it compromises or violates other aspects of fairness. This criticism becomes even more topical with the arrival of the Artificial Intelligence (AI) Act. This article identifies and applies the relevant rules of the proposed AI Act in relation to quantitative recidivism risk assessment. It does so by focusing on the proposed rules for the quality of the data and the models used, on biases, and on the human oversight. It is concluded that legislation may consider requiring providers of high-risk AI systems to demonstrate that their solution performs significantly better than risk assessments based on simple models, and better than human assessment. Furthermore, there is no single answer to evaluate the performance of quantitative recidivism risk assessment tools that are or may be deployed in practice. Finally, three approaches of human oversight are discussed to correct for the negative effects of quantitative risk assessment: the optional, benchmark, and feedback approach.
Original languageEnglish
Pages (from-to)407-423
Number of pages17
JournalEuropean Journal on Criminal Policy and Research
Volume28
Issue number3
Early online date10 Jun 2022
DOIs
Publication statusPublished - 9 Sept 2022

Keywords

  • COMPAS
  • OxRec
  • pre-trial detention
  • quantitative risk assessment
  • recidivism
  • JUDGMENT
  • Quantitative risk assessment
  • BIAS
  • Recidivism
  • Pre-trial detention
  • OXREC MODEL

Fingerprint

Dive into the research topics of 'Predicting Recidivism Risk Meets AI Act'. Together they form a unique fingerprint.

Cite this