Year: 2024
Type: preprint
Abstract: scida is a Python package for reading and analyzing large scientific data sets with support for various cosmological and galaxy formation simulations out-of-the-box. Data access is provided through a hierarchical dictionary-like data structure after a simple load() function. Using the dask library for scalable, parallel and out-of-core computation, all computation requests from a user session are first collected in a task graph. Arbitrary custom analysis, as well as all available dask (array) operations, can be performed. The subsequent computation is executed only upon request, on a target resource (e.g. a HPC cluster).
Source: arXiv (Cornell University)
Authors: Byrohl, Chris, Nelson, Dylan
Institution: Heidelberg University
Language: English
Subfield: Information Systems and Management
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
Funder: Deutsche Forschungsgemeinschaft
Awards: G1442695513, G8545501676
OpenAlex ID: W4401066429