TY - JOUR
T1 - Development and validation of the TOCO-TURBT tool
T2 - a summative assessment tool that measures surgical competency in transurethral resection of bladder tumour
AU - de Vries, Anna H.
AU - Muijtjens, Arno. M. M.
AU - van Genugten, Hilde G. J.
AU - Hendrikx, Ad. J. M.
AU - Koldewijn, Evert L.
AU - Schout, Barbara M. A.
AU - van der Vleuten, Cees P. M.
AU - Wagner, Cordula
AU - Tjiam, Irene M.
AU - van Merrienboer, Jeroen J. G.
PY - 2018/12
Y1 - 2018/12
N2 - BackgroundThe current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT).MethodsThe Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n=15), procedural (n=21), and completion (n=15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory.ResultsThe majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r>0.5, p
AB - BackgroundThe current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT).MethodsThe Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n=15), procedural (n=21), and completion (n=15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory.ResultsThe majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r>0.5, p
KW - Assessment
KW - Cognitive task analysis
KW - Certification
KW - Transurethral resection of bladder tumour
KW - Urology
KW - Validation
KW - OPERATIVE PERFORMANCE
KW - TECHNICAL PERFORMANCE
KW - OBJECTIVE ASSESSMENT
KW - PROCEDURAL SKILLS
KW - RELIABILITY
KW - PROGRAM
KW - VALIDITY
KW - SURGERY
KW - FEASIBILITY
KW - RECURRENCE
U2 - 10.1007/s00464-018-6251-8
DO - 10.1007/s00464-018-6251-8
M3 - Article
C2 - 29872946
SN - 0930-2794
VL - 32
SP - 4923
EP - 4931
JO - Surgical endoscopy and other interventional techniques
JF - Surgical endoscopy and other interventional techniques
IS - 12
ER -