Design and evaluation of a clinical competency committee

Marrigje E. Duitsman*, CorneliaR. M. G. Fluit, Janielle A. E. M. van Alfen-van der Velden, Marieke de Visser, Marianne ten Kate-Booij, Diana H. J. M. Dolmans, Debbie A. D. C. Jaarsma, Jacqueline de Graaf

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

In postgraduate medical education, group decision-making has emerged as an essential tool to evaluate the clinical progress of residents. Clinical competency committees (CCCs) have been set up to ensure informed decision-making and provide feedback regarding performance of residents. Despite this important task, it remains unclear how CCCs actually function in practice and how their performance should be evaluated.

In the prototyping phase of a design-based approach, a CCC meeting was developed, using three theoretical design principles: (1) data from multiple assessment tools and multiple perspectives, (2) a shared mental model and (3) structured discussions. The meetings were held in a university children's hospital and evaluated using observations, interviews with CCC members and an open-ended questionnaire among residents.

The structured discussions during the meetings provided a broad outline of resident performance, including identification of problematic and excellent residents. A shared mental model about the assessment criteria had developed over time. Residents were not always satisfied with the feedback they received after the meeting. Feedback that had been provided to a resident after the first CCC meeting was not addressed in the second meeting.

The principles that were used to design the CCC meeting were feasible in practice. Structured discussions, based on data from multiple assessment tools and multiple perspectives, provided a broad outline of resident performance. Residency programs that wish to implement CCCs can build on our design principles and adjust the prototype to their particular context. When running a CCC, it is important to consider feedback that has been provided to a resident after the previous meeting and to evaluate whether it has improved the resident's performance.

Original languageEnglish
Pages (from-to)1-8
Number of pages8
JournalPerspectives on Medical Education
Volume8
Issue number1
DOIs
Publication statusPublished - Feb 2019

Keywords

  • Design-based research
  • Clinical competency committee
  • Assessment
  • Postgraduate medical education
  • GROUP DECISION-MAKING
  • UNSHARED INFORMATION
  • SHARED INFORMATION
  • PERFORMANCE
  • JUDGMENT
  • FEEDBACK
  • IMPACT
  • SIZE

Cite this