Specification-Curve Analysis of Exposure and Eligibility Definitions in a Synthetic Medicare Cohort: How Raw Claims-Processing Decisions Shape Estimated Associations
Year: 2026
Type: preprint
Abstract: Purpose. Studies of Medicare claims rest on many small processing decisions about who enters the cohort, how drug exposure is defined and how follow-up is handled. These choices are rarely varied or reported together, so a single published estimate may reflect them as much as the underlying association. Methods. We used the 2008–2009 CMS DE-SynPUF Sample 1 synthetic Medicare claims file (116,352 beneficiaries; 114,538 alive at baseline). The outcome was hospitalization during 2009 and the exposure was any prescription drug claim in 2008. We crossed four cohort rules, two exposure definitions, two follow-up rules and two adjustment sets into 32 specifications and estimated the risk difference in each with robust standard errors. We tested the whole set jointly with the specification-curve procedure of Simonsohn and colleagues (500 resamples under a forced null) and measured how much of the variation each decision explains. Results. Risk differences ranged from 0.46 to 8.26 percentage points (median 3.89). Twenty-five of 32 specifications were significant, all in the positive direction, and the joint tests rejected the null (all P < 0.01). The cohort rule explained 66.1% of the variation among the estimates and the follow-up rule 15.4%; the exposure definition (0.05%) and covariate adjustment (0.01%) explained almost none. Requiring full-year Part D coverage raised the share classed as exposed from 62.3% to 97.5%. Conclusions. In this synthetic cohort the direction of the association was stable, but its size depended mainly on cohort eligibility rules rather than on the exposure definition or adjustment. Claims studies should report eligibility sensitivity analyses alongside their primary estimate. The data are synthetic and all findings are associational; no causal or drug-safety inference is intended.
Source: Preprints.org
Author: Olakunle Daniel Olorunkemi
Language: English
Subfield: Statistics and Probability
Field: Mathematics
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7236667174
