Impact of sampling and data collection methods on maternity survey response: a randomised controlled trial of paper and push-to-web surveys and a concurrent social media survey

BMC Medical Research Methodology

Research

Maria A. Quigley¹  Siân Harrison¹  Fiona Alderdice¹ 

[1] NIHR Policy Research Unit in Maternal and Neonatal Health and Care, National Perinatal Epidemiology Unit, Nuffield Department of Population Health, University of Oxford, Old Road Campus Headington, OX3 7LF, Oxford, UK;

关键词: Survey;    Questionnaire;    Sampling;    Response rate;    Representativeness;    Non-response bias;    Selection bias;    Weighting;    Pregnancy;    Maternity;    Randomised controlled trial (RCT);   

DOI  :  10.1186/s12874-023-01833-8

 received in 2022-07-25, accepted in 2023-01-03,  发布年份 2023

来源: Springer

【 摘 要 】

BackgroundNovel survey methods are needed to tackle declining response rates. The 2020 National Maternity Survey included a randomised controlled trial (RCT) and social media survey to compare different combinations of sampling and data collection methods with respect to: response rate, respondent representativeness, prevalence estimates of maternity indicators and cost.MethodsA two-armed parallel RCT and concurrent social media survey were conducted. Women in the RCT were sampled from ONS birth registrations and randomised to either a paper or push-to-web survey. Women in the social media survey self-selected through online adverts. The primary outcome was response rate in the paper and push-to-web surveys. In all surveys, respondent representativeness was assessed by comparing distributions of sociodemographic characteristics in respondents with those of the target population. External validity of prevalence estimates of maternity indicators was assessed by comparing weighted survey estimates with estimates from national routine data. Cost was also compared across surveys.ResultsThe response rate was higher in the paper survey (n = 2,446) compared to the push-to-web survey (n = 2,165)(30.6% versus 27.1%, difference = 3.5%, 95%CI = 2.1–4.9, p < 0.0001). Compared to the target population, respondents in all surveys were less likely to be aged < 25 years, of Black or Minority ethnicity, born outside the UK, living in disadvantaged areas, living without a partner and multiparous. Women in the social media survey (n = 1,316) were less representative of the target population compared to women in the paper and push-to-web surveys. For some maternity indicators, weighted survey estimates were close to estimates from routine data, for other indicators there were discrepancies; no survey demonstrated consistently higher external validity than the other two surveys. Compared to the paper survey, the cost saving per respondent was £5.45 for the push-to-web survey and £22.42 for the social media survey.ConclusionsPush-to-web surveys may cost less than paper surveys but do not necessarily result in higher response rates. Social media surveys cost significantly less than paper and push-to-web surveys, but sample size may be limited by eligibility criteria and recruitment window and respondents may be less representative of the target population. However, reduced representativeness does not necessarily introduce more bias in weighted survey estimates.

【 授权许可】

CC BY   
© The Author(s) 2023. corrected publication 2023

【 图 表 】

41116_2022_35_Article_IEq212.gif

41116_2022_35_Article_IEq210.gif

40249_2023_1056_Article_IEq5.gif

Fig. 39