Work

Early feedback elicitation and downstream participation behaviours: a retrospective observational analysis of study completion and disengagement

Year: 2026
Type: article
Abstract: BACKGROUND: Many health research studies and clinical trials face threats to external validity and low statistical power because they are unable to recruit and retain a sufficient number of participants. Identifying study design improvements using participant feedback is an important avenue through which studies seek to address these challenges. However, the returns on this approach have been limited because experience measures are rarely linked to actual participation behaviour. We examine whether feedback collected at the beginning of a research study can provide a meaningful signal about future participation as measured by study completion, withdrawal, and communication unsubscription. METHODS: We use observational data from a large health research program (N = 35,838; 77% from groups historically underrepresented in biomedical research, UBR) in which feedback was collected across the participant experience. We correlate feedback responses (e.g., indicating satisfaction with the experience) with study completion and active disengagement 6 months later and use Artificial Intelligence (AI) processing of free-text comments to surface specific topics and sentiment. FINDINGS: Ratings given immediately after onboarding are associated with an 8.89 percentage-point (pp) higher study completion rate ('Good' vs 'Fair') and a 23.22 pp higher active disengagement rate ('Poor' vs 'Fair') within 6 months. Associations for feedback collected later are smaller (up to 4.17 pp for completion). These differences hold after adjusting for participant characteristics (age, income, educational attainment, sex at birth, UBR on race/ethnicity, and UBR on rurality). We find no statistically significant effect of the prompt itself. AI-extracted topics and sentiment agree with human reviewers 86% and 81% of the time, respectively. INTERPRETATION: Early, light-touch feedback can meaningfully differentiate participants by their likelihood of completing or disengaging from a study, creating opportunities to target support and address flagged concerns while the study is still in progress. Feedback collected at the end of a study is a weaker signal of future behaviour. Our approach, including AI processing of free-text comments, is readily portable to other studies and feedback elicitations. Whether feedback-informed changes improve retention is an important question for future work. FUNDING: National Institutes of Health.
Source: EBioMedicine
Language: English
Field: Medicine
Open Access status: gold
Estimated APC paid: $5,780
OpenAlex ID: W4414140363
FWCI:
Cites: 29
Cited by:
Related to: 9