Year: 2015
Type: article
Abstract: MOTIVATION: The storage and transmission of high-throughput sequencing data consumes significant resources. As our capacity to produce such data continues to increase, this burden will only grow. One approach to reduce storage and transmission requirements is to compress this sequencing data. RESULTS: We present a novel technique to boost the compression of sequencing that is based on the concept of bucketing similar reads so that they appear nearby in the file. We demonstrate that, by adopting a data-dependent bucketing scheme and employing a number of encoding ideas, we can achieve substantially better compression ratios than existing de novo sequence compression tools, including other bucketing and reordering schemes. Our method, Mince, achieves up to a 45% reduction in file sizes (28% on average) compared with existing state-of-the-art de novo compression schemes. AVAILABILITY AND IMPLEMENTATION: Mince is written in C++11, is open source and has been made available under the GPLv3 license. It is available at http://www.cs.cmu.edu/∼ckingsf/software/mince. CONTACT: [email protected] SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.
Source: Bioinformatics
Authors: Rob Patro, Carl Kingsford
Institutions: Stony Brook University, Carnegie Mellon University
Language: English
Subfield: Theoretical Computer Science
Field: Mathematics
Domain: Physical Sciences
Keywords: mince, file size reduction
Open Access status: hybrid
Estimated APC paid: $3,989
Awards: Fast k-mer Counting to Quantify Gene Expression and Improve Genome Assembly, AF: Small: Multiscale Spectral Signatures for Local and Multi-objective Biological Network Alignment, Carl Kingsford Investigator Award, CAREER: Model-based Reconstruction of Ancient Biological Networks, Algorithms for Managing Uncertainty in Chromosome Conformation Capture Data
OpenAlex ID: W2159906372
