TY - JOUR
T1 - A Cost-Benefit Analysis of Reinterview Designs for Estimating and Adjusting Mode Measurement Effects
T2 - A Case Study for the Dutch Health Survey and Labour Force Survey
AU - Schouten, Barry
AU - Klausch, Thomas
AU - Buelens, Bart
AU - van den Brakel, Jan
N1 - data source:
PY - 2024/3/1
Y1 - 2024/3/1
N2 - Reinterview designs are a potential tool to estimate and adjust for mode measurement effects, that is, relative differences in mode-specific measurement error bias. In 2011, a reinterview design was successfully applied to the Dutch Crime Victimization Survey, which led to a redesign of the survey. Reinterview designs may, however, be very costly, especially when face to face is included as a survey mode. The crucial question is whether benefits outweigh costs, that is, whether the potential increase in the accuracy of survey statistics is worth the investment. The answer to this question depends heavily on the purpose of the reinterview, that is, assessment versus adjustment, the size of the measurement effects, and the relative cost of the modes. Reinterview designs also make a number of assumptions that will not hold for every setting. In this article, we perform a cost-benefit analysis for two surveys, the Dutch Health Survey and the Dutch Labour Force Survey, and discuss the utility and validity of reinterviews. We conclude that a reinterview may not be useful due to relatively small measurement differences for the Labour Force Survey, whereas it may be useful for the Health Survey.
AB - Reinterview designs are a potential tool to estimate and adjust for mode measurement effects, that is, relative differences in mode-specific measurement error bias. In 2011, a reinterview design was successfully applied to the Dutch Crime Victimization Survey, which led to a redesign of the survey. Reinterview designs may, however, be very costly, especially when face to face is included as a survey mode. The crucial question is whether benefits outweigh costs, that is, whether the potential increase in the accuracy of survey statistics is worth the investment. The answer to this question depends heavily on the purpose of the reinterview, that is, assessment versus adjustment, the size of the measurement effects, and the relative cost of the modes. Reinterview designs also make a number of assumptions that will not hold for every setting. In this article, we perform a cost-benefit analysis for two surveys, the Dutch Health Survey and the Dutch Labour Force Survey, and discuss the utility and validity of reinterviews. We conclude that a reinterview may not be useful due to relatively small measurement differences for the Labour Force Survey, whereas it may be useful for the Health Survey.
KW - Measurement error
KW - Mixed-mode surveys
KW - Mode effects
KW - Nonresponse
KW - Test-retest
KW - MEASUREMENT BIAS
KW - SELECTION
KW - ADJUSTMENT
KW - ERROR
U2 - 10.1093/jssam/smae011
DO - 10.1093/jssam/smae011
M3 - Article
SN - 2325-0984
JO - Journal of Survey Statistics and Methodology
JF - Journal of Survey Statistics and Methodology
M1 - smae011
ER -