On Inter-dataset Code Duplication and Data Leakage in Large Language Models
Year: 2023
Type: dataset
Abstract: This dataset encompasses the sparse graph referenced in the publication titled "On Inter-dataset Code Duplication and Data Leakage in Large Language Models." This resource is a snapshot of the original repository, and the graph is preserved in the interduplication.db database. The schema of this database is easily understandable and is available in the original repository. Each code snippet is identified by a unique identifier (id_within_dataset) that corresponds to its identification within the dataset from which it was extracted. The complete datasets are stored in .jsonl files within their respective folders (e.g., python-150/data.jsonl, codetrans/data.jsonl, etc.).
Authors: Hernández López, José Antonio, Chen, Boqi, Saaz, Mootez, Sharma, Tushar, Varró, Dániel
Institutions: Linköping University, McGill University, Dalhousie University
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4393496645