How well do covariates perform when adjusting for sampling bias in online COVID‑19 research? Insights from multiverse analyses
Archivos
Fecha
2022
Título de la revista
ISSN de la revista
Título del volumen
Editor
Springer Nature (Alemania; Reino Unido)
Resumen
COVID-19 research has relied heavily on convenience-based samples, which—though often necessary—are susceptible to important sampling biases. We begin with a theoretical overview and introduction to the dynamics that underlie samplingbias. We then empirically examine sampling bias in online COVID-19 surveys and evaluate the degree to which common statistical adjustments for demographic covariates successfully attenuate such bias. This registered study analysed responses to identical questions from three convenience and three largely representative samples (total N=13,731) collected online in Canada within the International COVID-19 Awareness and Responses Evaluation Study (www.icarestudy.com). We compared samples on 11 behavioural and psychological outcomes (e.g., adherence to COVID-19 prevention measures, vaccine intentions) across three time points and employed multiverse-style analyses to examine how 512 combinations of demographic covariates (e.g., sex, age, education, income, ethnicity) impacted sampling discrepancies on these outcomes. Signifcant discrepancies emerged between samples on 73% of outcomes. Participants in the convenience samples held more positive thoughts towards and engaged in more COVID-19 prevention behaviours. Covariates attenuated sampling diferences in only 55% of cases and increased diferences in 45%. No covariate performed reliably well. Our results suggest that online convenience samples may display more positive dispositions towards COVID-19 prevention behaviours being studied than would samples drawn using more representative means. Adjusting results for demographic covariates frequently increased rather than decreased bias, suggesting that researchers should be cautious when interpreting adjusted fndings. Using multiversestyle analyses as extended sensitivity analyses is recommended.
Descripción
Palabras clave
Cita
Joyal Desmarais, K,, Stojanovic, J., Kennedy, E. B., Enticott, J. C., Gosselin Boucher, V., Vo, H., Košir, U., Lavoie, K. L., Bacon, S. L., & iCARE Study Team. (2022). How well do covariates perform when adjusting for sampling bias in online COVID‑19 research? Insights from multiverse analyses. European Journal of Epidemiology, 37, 1233-1250. https://link.springer.com/article/10.1007/s10654-022-00932-y#citeas