Keyword

data deduplication

Description: A data-processing technique that identifies and removes redundant copies of data to reduce storage requirements, commonly used in storage and backup systems.

Primary topic: Data Quality and Management (24%)

Wikidata ID: wiki/Q1182260

OpenAlex ID: keywords/data-deduplication

SeqKit: A Cross-Platform and Ultrafast Toolkit for FASTA/Q File Manipulation

2016 · Wei Shen, Shuai Le, et al. · PLoS ONE · 3,362

PDF

Duplicate Record Detection: A Survey

2006 · Ahmed K. Elmagarmid, Panagiotis G. Ipeirotis, et al. · IEEE Transactions on Knowledge and Data Engineering · 1,979

De-duplication of database search results for systematic reviews in EndNote

2016 · Wichor M. Bramer, Dean Giustini, et al. · Journal of the Medical Library Association JMLA · 1,922

The merge/purge problem for large databases

1995 · Mauricio A. Hernández, Salvatore J. Stolfo · Proceedings - ACM-SIGMOD International Conference on Management of Data · 809

PDF

A low-bandwidth network file system

2001 · Athicha Muthitacharoen, Benjie Chen, et al. · 799

Venti: A New Approach to Archival Storage

2002 · Sean Quinlan, Sean Dorward · 738

Avoiding the disk bottleneck in the data domain deduplication file system

2008 · Benjamin Zhu, Li Kai, et al. · 708

A Survey of Indexing Techniques for Scalable Record Linkage and Deduplication

2011 · Peter Christen · IEEE Transactions on Knowledge and Data Engineering · 679

A study of practical deduplication

2012 · Dutch T. Meyer, William J. Bolosky · ACM Transactions on Storage · 540

Side Channels in Cloud Services: Deduplication in Cloud Storage

2010 · Danny Harnik, Benny Pinkas, et al. · IEEE Security & Privacy · 522

Swoosh: a generic approach to entity resolution

2008 · Omar Benjelloun, Hector Garcia-Molina, et al. · The VLDB Journal · 493

A Hybrid Cloud Approach for Secure Authorized Deduplication

2014 · Jin Li, Yan Kit Li, et al. · IEEE Transactions on Parallel and Distributed Systems · 413

Sparse Indexing: Large Scale, Inline Deduplication Using Sampling and Locality

2010 · Mark Lillibridge, Kave Eshghi, et al. · 395

Comprehensive Automated Quality Assurance of Daily Surface Observations

2010 · Imke Durre, Matthew J. Menne, et al. · Journal of Applied Meteorology and Climatology · 351

PDF

S$A: A Shared Cache Attack That Works across Cores and Defies VM Sandboxing -- and Its Application to AES

2015 · Gorka Irazoqui, Thomas Eisenbarth, et al. · Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and Privacy · 340

PDF

Extreme Binning: Scalable, parallel deduplication for chunk-based file backup

2009 · D. Bhagwat, K. Eshghi, et al. · 326

A Comprehensive Study of the Past, Present, and Future of Data Deduplication

2016 · Wen Xia, Hong Jiang, et al. · Proceedings of the IEEE · 319

OpenAlex Snapshot

2022 · Jason, Priem, Heather, Piwowar, et al. · arXiv (Cornell University) · 307

PDF

Secure data deduplication

2008 · Mark W. Storer, Kevin Greenan, et al. · 289

The adverse effects of code duplication in machine learning models of code

2019 · Miltiadis Allamanis · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · 281

PDF

Wait a Minute! A fast, Cross-VM Attack on AES

2014 · Gorka Irazoqui, Mehmet Sinan Inci, et al. · Lecture notes in computer science · 267

iDedup: latency-aware, inline data deduplication for primary storage

2012 · Kiran Srinivasan, Tim Bisson, et al. · 264

revtools: An R package to support article screening for evidence synthesis

2019 · Martin J. Westgate · Research Synthesis Methods · 260

Considerations for conducting systematic reviews: evaluating the performance of different methods for de-duplicating references

2021 · Sandra McKeown, Zuhaib M. Mir · Systematic Reviews · 250

An Introduction to Duplicate Detection

2010 · Felix Naumann, Melanie Herschel · Synthesis lectures on data management · 248

Works count: 7,620

Citation count: 54,300