TY - JOUR
T1 - Checklists improve experts' diagnostic decisions
AU - Sibbald, Matthew
AU - de Bruin, Anique B. H.
AU - van Merrienboer, Jeroen J. G.
PY - 2013/3
Y1 - 2013/3
N2 - Context Checklists are commonly proposed tools to reduce error. However, when applied by experts, checklists have the potential to increase cognitive load and result in expertise reversal'. One potential solution is to use checklists in the verification stage, rather than in the initial interpretation stage of diagnostic decisions. This may avoid expertise reversal by preserving the experts' initial approach. Whether checklist use during the verification stage of diagnostic decision making improves experts' diagnostic decisions is unknown. Methods Fifteen experts interpreted 18 electrocardiograms (ECGs) in four different conditions: undirected interpretation; verification without a checklist; verification with a checklist, and interpretation combined with verification with a checklist. Outcomes included the number of errors, cognitive load, interpretation time and interpretation length. Outcomes were compared in two analyses: (i) a comparison of verification conditions with and without a checklist, and (ii) a comparison of all four conditions. Standardised scores for each outcome were used to calculate the efficiency of a checklist and to weigh its relative benefit against its relative cost in terms of cognitive load imposed, interpretation time and interpretation length. Results In both analyses, checklist use was found to reduce error (more errors were corrected in verification conditions with checklists [0.29 +/- 0.77 versus 0.03 +/- 0.61 errors per ECG], and fewer net errors occurred in all conditions with checklists [0.39 +/- 1.14 versus 1.04 +/- 1.49 errors per ECG]; p
AB - Context Checklists are commonly proposed tools to reduce error. However, when applied by experts, checklists have the potential to increase cognitive load and result in expertise reversal'. One potential solution is to use checklists in the verification stage, rather than in the initial interpretation stage of diagnostic decisions. This may avoid expertise reversal by preserving the experts' initial approach. Whether checklist use during the verification stage of diagnostic decision making improves experts' diagnostic decisions is unknown. Methods Fifteen experts interpreted 18 electrocardiograms (ECGs) in four different conditions: undirected interpretation; verification without a checklist; verification with a checklist, and interpretation combined with verification with a checklist. Outcomes included the number of errors, cognitive load, interpretation time and interpretation length. Outcomes were compared in two analyses: (i) a comparison of verification conditions with and without a checklist, and (ii) a comparison of all four conditions. Standardised scores for each outcome were used to calculate the efficiency of a checklist and to weigh its relative benefit against its relative cost in terms of cognitive load imposed, interpretation time and interpretation length. Results In both analyses, checklist use was found to reduce error (more errors were corrected in verification conditions with checklists [0.29 +/- 0.77 versus 0.03 +/- 0.61 errors per ECG], and fewer net errors occurred in all conditions with checklists [0.39 +/- 1.14 versus 1.04 +/- 1.49 errors per ECG]; p
U2 - 10.1111/medu.12080
DO - 10.1111/medu.12080
M3 - Article
C2 - 23398016
SN - 0308-0110
VL - 47
SP - 301
EP - 308
JO - Medical Education
JF - Medical Education
IS - 3
ER -