AICD Bench: A Challenging Benchmark for AI-Generated Code Detection
Year: 2026
Type: other
Abstract: Large language models (LLMs) are increasingly capable of generating functional source code, raising questions about authorship, accountability, and security. While detecting AI-generated code is critical, existing datasets and benchmarks are narrow, typically limited to binary human-machine classification under in-distribution settings. To bridge this gap, we introduce AICD Bench, the most comprehensive benchmark for AI-generated code detection. It spans 2M samples, 77 models across 11 families, and 9 programming languages, including new reasoning models. Beyond scale, AICD Bench introduces three realistic detection tasks: (i) Robust Binary Classification under distribution shifts in language and domain; (ii) Model Family Attribution, grouping generators by architectural lineage; and (iii) Fine-Grained Human-Machine Classification across human, machine, hybrid, and adversarial code. We evaluate neural and classical detectors and show that performance remains far below practical usability, underscoring task difficulty. We release a unified, challenging evaluation suite to drive the next generation of robust approaches for AI-generated code detection
Source: Underline Science Inc.
DOI: 10.48448/c6az-9342
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7155394228
Cites:
Cited by:
Related to: