Researcher Degrees of Freedom in Psychotherapy Studies: A Systematic Assessment and Comparison of Publications and Registrations of Randomized Controlled Trials of Mindfulness-Based Interventions for Depressive Symptoms
Year: 2026
Type: preprint
Abstract: Opportunistic use of flexibility in methodological decisions undermine the credibility of trial findings. Sufficiently specific clinical trial registrations and protocols can help constrain “researcher degrees of freedom” (RDFs). In this preregistered study, we studied the prevalence and quality of registrations and protocols in a stratified random sample of 95 randomized controlled trials of mindfulness-based interventions for depressive symptoms. We assessed strictness, consistency with the corresponding publication, and overall effectiveness in limiting researcher degrees of freedom using a protocol with 27 items across six methodological domains. Thirty-two trials (33.7%) were registered prospectively; 31 (32.6%) retrospectively, and three (3.2%) had unclear timing. Fifteen trials (15.8%) had a publicly available protocol (one prospective). Registrations had mean strictness, consistency, and effectiveness scores of 0.50, 0.42, and 0.36, respectively (on a scale from 0-1), compared with 0.76, 0.69, and 0.60 for protocols. Effectiveness in registrations differed per methodological domain, ranging from 0.62 for the description of interventions to 0.02 for statistical methods. Effectiveness did not differ significantly between prospective and retrospective registrations. Our findings indicate that registrations alone do not fully eliminate the biases caused by RDFs in trials of mindfulness-based interventions. We offer recommendations for improving prospective registration, transparent reporting, and peer review checks to strengthen the credibility of psychotherapy research.
Source: PsyArXiv (OSF Preprints)
Language: English
Subfield: Statistics, Probability and Uncertainty
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7235297804
