Work

Building a continuous benchmarking ecosystem in bioinformatics

Year: 2025

Type: article

Abstract: Benchmarking, which involves collecting reference datasets and demonstrating method performance, is a requirement for the development of new computational tools, but also becomes a domain of its own to achieve neutral comparisons of methods. Although a lot has been written about how to design and conduct benchmark studies, this Perspective sheds light on a wish list for a computational platform to orchestrate benchmark studies. We discuss various ideas for organizing reproducible software environments, formally defining benchmarks, orchestrating standardized workflows, and how they interface with computing infrastructure.

Source: Zurich Open Repository and Archive (University of Zurich)

DOI: 10.5167/uzh-283579

Authors: Mallona, Izaskun, Soneson, Charlotte, Carrillo, Ben, Lütge, Almut, Incicau, Daniel, Gerber, Reto, Sonrel, Anthony, Robinson, Mark D.

Language: English

Topic: Scientific Computing and Data Management

Subfield: Information Systems and Management

Field: Decision Sciences

Domain: Social Sciences

Open Access status: green

OpenAlex ID: W7126034413

FWCI:

Cites:

Cited by:

Related to: