TY - JOUR
T1 - Questionnaires vs Interviews for the Assessment of Global Functional Outcomes After Traumatic Brain Injury
AU - Horton, Lindsay
AU - Rhodes, Jonathan
AU - Menon, David K.
AU - Maas, Andrew I. R.
AU - Wilson, Lindsay
AU - van Heugten, Caroline M.
AU - CENTER-TBI Participants and Investigators
N1 - Funding Information:
Author Contributions: Drs Horton and Wilson had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: Horton, Menon, Maas, Wilson. Acquisition, analysis, or interpretation of data: All authors. Drafting of the manuscript: Horton, Wilson. Critical revision of the manuscript for important intellectual content: All authors. Statistical analysis: Horton, Wilson. Obtained funding: Menon, Maas. Administrative, technical, or material support: Rhodes, Menon, Maas. Supervision: Rhodes, Menon, Maas, Wilson. Conflict of Interest Disclosures: Dr Menon reported receiving grants from the European Union 7th Framework Programme and the National Institute for Health Research (UK) during the conduct of the study and receiving grants from Lantmannen AB, grants and personal fees from GlaxoSmithKline and PresSura Neuro Ltd, and personal fees from Calico outside the submitted work. Dr Maas reported receiving grants from the European Union 7th Framework Programme and Hannelore Kohl Stiftung to Antwerp University Hospital during the conduct of the study; grants from Integra LifeSciences and NeuroTrauma Sciences to Antwerp University Hospital outside the submitted work; and personal fees from PresSura Neuro Ltd outside the submitted work. Dr Wilson reported receiving grants from the European Union 7th Framework Programme to the University of Stirling during the conduct of the study and receiving personal fees from Roche Pharma, Vasopharm, and Novartis outside the submitted work. No other disclosures were reported. Funding/Support: This study was funded by EC grant 602150 from the European Union 7th Framework Programme. Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Funding Information:
Hungarian Brain Research Program - Grant No. KTIA_13_NAP-A-II/8, University of Pécs, Pécs, Hungary
Publisher Copyright:
© 2021 Horton L et al.
PY - 2021/11/11
Y1 - 2021/11/11
N2 - IMPORTANCE An interview is considered the gold standard method of assessing global functional outcomes in clinical trials among patients with acute traumatic brain injury (TBI). However, several multicenter clinical trials have used questionnaires completed by a patient or caregiver to assess the primary end point.OBJECTIVE To examine agreement between interview and questionnaire formats for assessing TBI outcomes and to consider whether an interview has advantages.DESIGN, SETTING, AND PARTICIPANTS This cohort study used data from patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) project from December 2014 to December 2017. Data were analyzed from December 2020 to April 2021. Included patients were aged 16 years or older with TBI and a clinical indication for computed tomography imaging. Outcome assessments were completed using both an interview and a questionnaire at follow-up 3 and 6 months after injury.EXPOSURES Traumatic brain injury of all severities.MAIN OUTCOMES AND MEASURES Ratings on the Glasgow Outcome Scale-Extended (GOSE) administered as a structured interview rated by an investigator and as a questionnaire completed by patients or caregivers and scored centrally were compared, and the strength of agreement was evaluated using weighted kappa statistics. Secondary outcomes included comparison of different sections of the GOSE assessments and the association of GOSE ratings with baseline factors and patient-reported mental health, health-related quality of life, and TBI symptoms.RESULTS Among the 3691 eligible individuals in the CENTER-TBI study, both GOSE assessment formats (interview and questionnaire) were completed by 994 individuals (26.9%) at 3 months after TBI (654 [65.8%] male; median age, 53 years [IQR, 33-66 years]) and 628 (17.0%) at 6 months (409 [65.1%] male; median age, 51 years [IQR, 31-64 years]). Outcomes of the 2 assessment methods agreed well at both 3 months (weighted kappa, 0.77; 95% CI, 0.73-0.80) and 6 months (weighted kappa, 0.82; 95% CI, 0.78-0.86). Furthermore, item-level agreement between the 2 methods was good for sections regarding independence in everyday activities (kappa, 0.70-0.79 across both time points) and moderate for sections regarding subjective aspects of functioning such as relationships and symptoms (kappa, 0.41-0.51 across both time points). Compared with questionnaires, interviews recorded more problems with work (294 [30.5%] vs 233 [24.2%] at 3 months and 161 [26.8%] vs 136 [22.7%] at 6 months), fewer limitations in social and leisure activities (330 [33.8%] vs 431 [44.1%] at 3 months and 179 [29.7%] vs 219 [36.4%] at 6 months), and more symptoms (524 [53.6%] vs 324 [33.1%] at 3 months and 291 [48.4%] vs 179 [29.8%] at 6 months). Interviewers sometimes assigned an overall rating based on judgment rather than interview scoring rules, particularly for patients with potentially unfavorable TBI outcomes. However, for both formats, correlations with baseline factors (rho, -0.13 to 0.42) and patient-reported outcomes (rho, 0.29 to 0.65) were similar in strength.CONCLUSIONS AND RELEVANCE In this cohort study, GOSE ratings obtained by questionnaire and interview methods were in good agreement. The similarity of associations of the ratings obtained by both GOSE methods with baseline factors and other TBI outcome measures suggests that despite some apparent differences, the core information collected by both interviews and questionnaires was similar. The findings support the use of questionnaires in studies in which this form of contact may offer substantial practical advantages compared with interviews.
AB - IMPORTANCE An interview is considered the gold standard method of assessing global functional outcomes in clinical trials among patients with acute traumatic brain injury (TBI). However, several multicenter clinical trials have used questionnaires completed by a patient or caregiver to assess the primary end point.OBJECTIVE To examine agreement between interview and questionnaire formats for assessing TBI outcomes and to consider whether an interview has advantages.DESIGN, SETTING, AND PARTICIPANTS This cohort study used data from patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) project from December 2014 to December 2017. Data were analyzed from December 2020 to April 2021. Included patients were aged 16 years or older with TBI and a clinical indication for computed tomography imaging. Outcome assessments were completed using both an interview and a questionnaire at follow-up 3 and 6 months after injury.EXPOSURES Traumatic brain injury of all severities.MAIN OUTCOMES AND MEASURES Ratings on the Glasgow Outcome Scale-Extended (GOSE) administered as a structured interview rated by an investigator and as a questionnaire completed by patients or caregivers and scored centrally were compared, and the strength of agreement was evaluated using weighted kappa statistics. Secondary outcomes included comparison of different sections of the GOSE assessments and the association of GOSE ratings with baseline factors and patient-reported mental health, health-related quality of life, and TBI symptoms.RESULTS Among the 3691 eligible individuals in the CENTER-TBI study, both GOSE assessment formats (interview and questionnaire) were completed by 994 individuals (26.9%) at 3 months after TBI (654 [65.8%] male; median age, 53 years [IQR, 33-66 years]) and 628 (17.0%) at 6 months (409 [65.1%] male; median age, 51 years [IQR, 31-64 years]). Outcomes of the 2 assessment methods agreed well at both 3 months (weighted kappa, 0.77; 95% CI, 0.73-0.80) and 6 months (weighted kappa, 0.82; 95% CI, 0.78-0.86). Furthermore, item-level agreement between the 2 methods was good for sections regarding independence in everyday activities (kappa, 0.70-0.79 across both time points) and moderate for sections regarding subjective aspects of functioning such as relationships and symptoms (kappa, 0.41-0.51 across both time points). Compared with questionnaires, interviews recorded more problems with work (294 [30.5%] vs 233 [24.2%] at 3 months and 161 [26.8%] vs 136 [22.7%] at 6 months), fewer limitations in social and leisure activities (330 [33.8%] vs 431 [44.1%] at 3 months and 179 [29.7%] vs 219 [36.4%] at 6 months), and more symptoms (524 [53.6%] vs 324 [33.1%] at 3 months and 291 [48.4%] vs 179 [29.8%] at 6 months). Interviewers sometimes assigned an overall rating based on judgment rather than interview scoring rules, particularly for patients with potentially unfavorable TBI outcomes. However, for both formats, correlations with baseline factors (rho, -0.13 to 0.42) and patient-reported outcomes (rho, 0.29 to 0.65) were similar in strength.CONCLUSIONS AND RELEVANCE In this cohort study, GOSE ratings obtained by questionnaire and interview methods were in good agreement. The similarity of associations of the ratings obtained by both GOSE methods with baseline factors and other TBI outcome measures suggests that despite some apparent differences, the core information collected by both interviews and questionnaires was similar. The findings support the use of questionnaires in studies in which this form of contact may offer substantial practical advantages compared with interviews.
KW - INITIAL CONSERVATIVE TREATMENT
KW - HEAD-INJURY
KW - INTRACEREBRAL HEMORRHAGE
KW - EARLY SURGERY
KW - CENTER-TBI
KW - TRIAL
KW - MULTICENTER
KW - COEFFICIENT
KW - RELIABILITY
KW - AGREEMENT
U2 - 10.1001/jamanetworkopen.2021.34121
DO - 10.1001/jamanetworkopen.2021.34121
M3 - Article
SN - 2574-3805
VL - 4
JO - Jama network open
JF - Jama network open
IS - 11
M1 - 2134121
ER -