Replication Package: The State of Open Science in Software Engineering Research: A Case Study of ICSE Artifacts
Year: 2026
Type: conference-paper
Abstract: This replication package accompanies our study evaluating the executability, reproducibility, and usability of replication packages from ICSE research papers. We analyzed 100 artifacts from ICSE papers published between 2015-2024, assessing their practical usability through systematic execution attempts in controlled environments. Key Findings: Only 40% of artifacts were fully executable Only 32.5% ran without any modifications 82.5% required moderate to high effort to execute Among executable artifacts, only 35% reproduced the original results
Author: Al, Muttakin
Language: English
Subfield: Information Systems and Management
Field: Decision Sciences
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7118968409
FWCI:
Cites:
Cited by:
Related to: