Work

Evaluating the performance of RefWorks, Deduklick, and Systematic Review Accelerator for deduplicating references: Considerations for conducting evidence syntheses

Year: 2023
Type: review
Abstract: Introduction: There are various automated electronic methods for deduplicating references after searching multiple resources during the process of conducting an evidence synthesis including deduplication features in citation managers and systematic review tools. This research examines the performance of default algorithms for deduplicating references in RefWorks (using the revamped deduplication feature released by ProQuest in November 2022), Deduklick (introduced in 2022 as a stand-alone deduplication AI tool), and Systematic Review Accelerator (a suite of automation tools that includes a "Deduplicator" feature). Methods: Database search strategies from a previously conducted evidence synthesis were used to collect a heterogenous sample of references from the following Ovid databases: MEDLINE, Embase, PsycINFO and Cochrane CENTRAL. Manual abstraction of the sample of references was used to identify duplicates and develop a benchmark for comparing deduplicated references from RefWorks, Deduklick, and Systematic Review Accelerator. The number of false negative and false positive references generated by each program was determined to calculate accuracy, sensitivity, and specificity. Results: The performance of default settings for deduplicating references in RefWorks, Deduklick, and Systematic Review Accelerator will be presented and directly compared to other citation managers and systematic review software programs, which have been previously evaluated and reported on using the same sample of references and process of analysis. Conclusions: The performance of electronic methods for deduplicating references should be taken into consideration when conducting evidence syntheses to avoid unintentionally removing eligible studies, which could introduce bias. The cost and availability of programs that deduplicate references may limit and/or exclude their use among researchers, which may have implications for evidence synthesis quality.
Language: English
Open Access status: green
OpenAlex ID: W7214509221
FWCI:
Cites: 3
Cited by:
Related to: 9