Too-good-to-be-true: explaining large effects from common exposures in epidemiologic studies
Year: 2026
Type: article
Abstract: Background Epidemiologic studies reporting large effects attract high attention in the scientific community compared to studies with smaller effects or null findings. Claims about strong effects of everyday exposures on common diseases also gain interest in non-scientific (social) media, even when they appear implausible (“too-good-go-be-true”) according to common sense. We assessed whether such effects are based on sound methodology. Methods We screened a major news magazine (Spiegel), two newspapers (Stuttgarter und Süddeutsche Zeitung) and the section “most read” of the leading German medical journal (Deutsches Ärzteblatt) for reports on epidemiologic studies with implausible effects published from July to December 2023. We examined the underlying publications regarding study population, methods and reporting to identify issues that potentially influencing the results. Results Five of 47 studies featured in the news media and four of 18 studies in the medical journal reported implausible effects, three studies were covered by two media. Reported findings included a 30% reduction in cardiovascular risk from low alcohol intake, up to 80% lower cancer risk and 67% lower heart failure risk from short intensive physical activity, up to 24 additional years of life associated with a healthy lifestyle, and a 50% increase in dementia risk from specific sugars. We identified underlying issues including inappropriate reference groups, arbitrary exposure cut-offs, selection and survivor bias, inadequate exposure measurement, extrapolation, selective reporting, and conflicts of interest. Conclusions Methodological flaws contribute to effects that seem “too-good-to-be-true” in epidemiologic studies. The majority could have been identified without advanced statistical expertise. Our findings underscore an urgent need for better scrutiny of “surprising” findings to prevent dissemination of misleading or even adverse public health information.
Authors: S Stolpe, HC Vollmar, B Kowall
Institutions: Ruhr University Bochum, Essen University Hospital
Language: English
Subfield: Statistics and Probability
Field: Mathematics
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,181
OpenAlex ID: W7223677484