Work

Adjusting Snakemake's Maximum File Size for Checksums

Year: 2025

Type: conference-paper

Abstract: Snakemake calculates checksums for input and output files during DAG building to determine if a rule needs to be re-executed. For huge files, computing these checksums can be a significant performance bottleneck, slowing down the DAG generation process. This paper describes the limiting of checksum calculation upon file sizes.

Source: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.15489401

Authors: Schmitz, Johanna Elena, Zentgraf, Jens

Institution: Saarland University

Language: English

Topic: Scientific Computing and Data Management

Subfield: Information Systems and Management

Field: Decision Sciences

Domain: Social Sciences

Open Access status: green

OpenAlex ID: W6949427323

FWCI:

Cites:

Cited by:

Related to: