Mapping of Target Trial Emulations and Randomized Controlled Trials
Year: 2025
Type: article
Abstract: PROTOCOL TITLE: Mapping of Target Trial Emulations and Randomized Controlled Trials AUTHORS: Karl Abou Chacra, Kenny Lim, Philippe Ravaud, Isabelle Boutron, Sally Yaacoub AUTHOR AFFILIATIONS: Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe, Centre for Research in Epidemiology and Statistics (CRESS), F-75004 Paris, France Centre d'Épidémiologie Clinique, Hôpital Hôtel Dieu, AP-HP, 1 Parvis de Notre Dame, Université Paris Cité, 75004 Paris, France. Cochrane France CORRESPONDING AUTHOR: Sally Yaacoub, BS Pharm, MPH, PhD Université Paris Cité and Université Sorbonne Paris Nord, Inserm, INRAe Center for Research in Epidemiology and Statistics (CRESS) Cochrane France Hôpital Hôtel Dieu, 1 place du Parvis Notre-Dame, 75004 Paris, France Email: [email protected] INTRODUCTION Randomized controlled trials (RCTs) have been considered by researchers and clinicians to be the gold standard for establishing a causal relationship between a specific intervention and a respective outcome. Decision makers favor RCTs not just because of their inherent randomization, but also due to their ability to precisely control patient characteristics and health outcomes.1 However, not all clinical questions are suited to be answered by RCTs, either because of problems regarding funding, feasibility, or time related reasons. In addition, RCTs often have the problem of being applicable to only a very narrow patient population. Thus, real world data (RWD) are especially relevant as they provide the evidence to answer clinical questions for which there is no existing or suitable RCT, as well as allow for a larger, more representative population to be studied. 2 Unfortunately, nonrandomized studies bring with them their own set of analytical problems: such as confounding bias, and the various associated assumptions. These assumptions include: exchangeability, where participants in the study may be exchanged between treatment and control groups without altering the average treatment effect; consistency, where only one version of the treatment is being tested; positivity, where every participant has a non-zero probability of receiving any treatment option under investigation given their measured covariates; and non- interference, where the treatment given to any one participant does not affect the outcomes of other participants.13 However, analyzing RWD in a framework designed to emulate RCTs as close as possible may mitigate some of the biases that would be present in the standard observational study. This design, the target trial emulation (TTE), involves specifying the protocol of the target trial and then emulating it as using observational data. It requires the eligibility criteria, treatment strategies, follow-up, and outcomes of interest to be prespecified in the protocol.3 There is an increasing amount TTEs currently being published due to their ability to provide evidence on larger patient populations, more diverse treatments, and longer outcomes (such as rare events and adverse events).2 Several studies, such as the RCT-DUPLICATE project, have been undertaken to assess the alignment of RWD specifically aiming to emulate a target trial with RCT findings, whereby the FDA selected 32 published RCTs of the treatment of various diseases, for which the corresponding RWD studies were conducted.12 TTEs are an important approach to validate and complement RCT findings, as they allow for the assessment of the external validity of the proposed causal pathway, especially over longer periods of time. Benchmarking TTEs against RCTs with similar causal questions may provide insight on their relevance in answering clinical questions, especially in the context where TTEs do not have any corresponding RCTs. This may help clinicians and readers to understand the scope of a TTE, and its role in addressing clinical questions. To our knowledge, no study has mapped the evidence of existing observational studies specifically aiming to emulate a target trial with the evidence provided by randomized controlled trials. Objectives This study aims to map target trial emulations to randomized controlled trials and compare their characteristics and effect estimates. METHODS Study Design This will be a meta-epidemiological study. Identifying target trial emulations Eligibility and search We will use the same eligibility criteria for indication of a TTE as Hansford et. al in their systematic review.3 We will include studies that explicitly aim to emulate a target trial of a medical intervention, using the terms specified in the Appendix. We will exclude studies that do not investigate a medical intervention, that were not conducted in humans, or were not written in English. We will also exclude protocols and pre-prints. We will search three electronic databases: Medline (Ovid), Embase, and Web of Science, using the search strategy reported by Hansford et al. in their systematic review (Appendix 3), however we will limit the search from database inception to the day of the search.3 Similarly, we will use CitationChaser for forward citation tracking of five main articles on target trial emulation framework.5, 6, 7, 8, 9 We will restrict the forward citation to Jan. 1, 2022 – Jan. 15, 2025, to complement the search of Hansford et al. We will also screen the references of relevant systematic reviews, including those of Hansford et al. Screening and Classification We will first do a preliminary screening on solely the title and abstract. This will be done by two independent reviewers in duplicate on Covidence. We will resolve disagreements through discussion, or the input of a third reviewer. With the identification of potentially eligible TTEs, we will then classify them into different medical fields and type of intervention. These tags are specified in the Appendix. Following this, we will retrieve the full-texts of potentially eligible studies and two reviewers will independently screen them against the eligibility criteria. We will resolve disagreements through discussion, or the input of a third reviewer. Identifying the clinical questions and eligibility criteria of target trial emulations After the classification of each eligible study, we will extract the characteristics of the studies (the title, authors, and date of publication). We will also extract the components of the clinical question in the PICO format (participants, intervention, comparators, outcomes), and the eligibility criteria and setting. Identifying matching randomized controlled trials Using the clinical question of the each TTE, we will develop a search strategy to conduct a literature search using relevant terms and keywords. We aim to identify individual randomized controlled trials (RCTs) through relevant databases. Following this, we will use the P, I and C components of the TTEs to retrieve potential matches with RCTs. Then, we will establish these matches using eligibility criteria of each TTE to screen the search hits and identify the relevant RCTs. Data Extraction For each TTE and RCT, we will extract: - The general characteristics e.g. authors, title, publication date, aim, region, setting, number of centers, the data used, the source of the data, recruitment duration, and overall follow up. - The participant characteristics: o target populations, condition, participants eligible, participants analyzed, number of centers, condition severity, demographic characteristics (e.g., age and gender distribution) and the eligibility criteria (inclusion and exclusion) - The intervention characteristics: o definition, description, drug, initiation/continuation status, number of participants, type of intervention, and assignment procedure - comparator characteristics o definition, drug, number of participants, and type of comparator - The outcome characteristics: o Primary and secondary outcomes of interest, duration of follow up for each outcome, statistical measure for each outcome, effect size, and confidence interval. Additionally, the type of statistical analysis used to emulate the target trial (propensity score matching, inverse probability weighting methods…etc.) will be documented. We will also document the confounding factors considered and methods for adjustment. We will also note the causal contrast of interest for the RCTs. Analysis We will report the proportion of TTEs that do not have a match to any RCT, those that have only one matched RCT, and those that have several matched RCTs. We will conduct descriptive statistics to the characteristics among those included in the matched TTE and RCT pairs and highlight the differences between them. The characteristics to be compared are: - Participant characteristics: o disease severity (if applicable) o age and gender distribution o exclusion criteria - Sample size - Setting - Timeline of the study - Intervention characteristics: o Definition, type of intervention - Comparator characteristics: o Definition, type of comparator (e.g., active comparator, or standard care) - Outcome characteristics: o outcome of interest, the effect estimates - Duration of follow up. Additionally, with respect to their effect estimates, we will report the proportion of matched TTEs and RCTs results that are concordant or discordant. If the results are binary, concordance is determined through the assessment of the relative risk ratio, calculated as the relative risk (RR) of the RCT over the RR of the TTE. If the resulting value is lower than 0.7 or greater than 1.43 (the reciprocal), this would signify extreme discordance between the results of the study. if the
Language: English
Subfield: Statistics and Probability
Field: Mathematics
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W6967870690
FWCI:
Cites:
Cited by:
Related to: