Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
AI benchmarking
Description:
Methods and tests for measuring and comparing the performance of artificial intelligence systems, algorithms, and computing platforms.
Related topics:
Artificial Intelligence in Healthcare and Education (11%),
Ethics and Social Impacts of AI (9%),
Artificial Intelligence Applications (9%)
OpenAlex ID:
keywords/ai-benchmarking
GDPVAL: Evaluating AI Model Performance on Real-World Economically Valuable Tasks
2026
·
Tejal Patwardhan
, Rachel Dias
, et al.
·
SuperIntelligence - Robotics - Safety & Alignment
·
263
PDF
ARC Prize 2024: Technical Report
2024
·
Chollet, Francois
, Knoop, Mike
, et al.
·
arXiv (Cornell University)
·
234
PDF
The Leaderboard Illusion
2025
·
Shivalika Singh
, Yiyang Nan
, et al.
·
neural information processing systems
·
145
Crowdsourced Frontier: Unveiling Autonomous Adversarial Cybercapabilities via Open AI Competition
2023
·
Sai Yeswanth Maturi
·
International Journal of Intelligent Systems and Applications in Engineering
·
99
PDF
Trustworthy agentic AI systems: a cross-layer review of architectures, threat models, and governance strategies for real-world deployment
2025
·
IBRAHIM ADABARA
, Bashir Olaniyi Sadiq
, et al.
·
F1000Research
·
76
PDF
Impact of Confounding Thoracic Tubes and Pleural Dehiscence Extent on Artificial Intelligence Pneumothorax Detection in Chest Radiographs
2020
·
Johannes Rueckel
, Lena Trappmann
, et al.
·
Investigative Radiology
·
62
How Well Do Machines Perform on IQ tests: a Comparison Study on a Large-Scale Dataset
2019
·
Yusen Liu
, Fangyuan He
, et al.
·
International Joint Conference on Artificial Intelligence
·
57
PDF
BigDataBench: A Scalable and Unified Big Data and AI Benchmark Suite
2018
·
Gao, Wanling
, Zhan, Jianfeng
, et al.
·
arXiv (Cornell University)
·
57
PDF
AIBench: An Industry Standard Internet Service AI Benchmark Suite
2019
·
Gao, Wanling
, Tang, Fei
, et al.
·
arXiv (Cornell University)
·
52
PDF
Imagining and building wise machines: the centrality of AI metacognition
2026
·
Samuel G.B. Johnson
, Amir-Hossein Karimi
, et al.
·
Trends in Cognitive Sciences
·
49
PDF
Artificial Intelligence for Response Assessment in Neuro Oncology (AI-RANO), part 1: review of current advancements
2024
·
Javier E Villanueva-Meyer
, Spyridon Bakas
, et al.
·
The Lancet Oncology
·
41
PDF
AIBench: Towards Scalable and Comprehensive Datacenter AI Benchmarking
2019
·
Wanling Gao
, Chunjie Luo
, et al.
·
Lecture notes in computer science
·
40
Dota 2 Bot Competition
2018
·
Jose M. Font
, Tobias Mahlmann
·
IEEE Transactions on Games
·
39
PDF
The Application of Large Language Models for Radiologic Decision Making
2024
·
Hossam A. Zaki
, Andrew Aoun
, et al.
·
Journal of the American College of Radiology
·
38
Direct Human-AI Comparison in the Animal-AI Environment
2022
·
Konstantinos Voudouris
, Matthew Crosby
, et al.
·
Frontiers in Psychology
·
29
AI Benchmarking for Science: Efforts from the MLCommons Science Working Group
2022
·
Jeyan Thiyagalingam
, Gregor von Laszewski
, et al.
·
Lecture notes in computer science
·
26
Vibe Code Bench: Evaluating AI Models on End-to-End Web Application Development
2026
·
Hung Tran
, Langston Nashold
, et al.
·
ACM Conference on AI and Agentic Systems (CAIS)
·
24
AIBench Scenario: Scenario-Distilling AI Benchmarking
2021
·
Wanling Gao
, Fei Tang
, et al.
·
International Conference on Parallel Architectures and Compilation Techniques (PACT)
·
22
PDF
HISIM: Analytical Performance Modeling and Design Space Exploration of 2.5D/3D Integration for AI Computing
2025
·
Zhenyu Wang
, Pragnya Sudershan Nalla
, et al.
·
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
·
21
Adding External Artificial Intelligence (AI) into Internal Firm-Wide Smart Dynamic Warehousing Solutions
2024
·
John Hamilton
, Stephen Maxwell
, et al.
·
Sustainability
·
21
PDF
Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks
2023
·
Mingyu Liang
, Wenyin Fu
, et al.
·
Proceedings - International Symposium on Computer Architecture/Proceedings
·
21
PDF
Assessing knowledge about medical physics in language-generative AI with large language model: using the medical physicist exam
2024
·
Noriyuki Kadoya
, Kazuhiro Arai
, et al.
·
Radiological Physics and Technology
·
16
Benchmarking is Broken -- Don't Let AI be its Own Judge
2025
·
Cheng, Zerui
, Wohnig, Stella
, et al.
·
arXiv (Cornell University)
·
15
PDF
The imitation game: large language models versus multidisciplinary tumor boards: benchmarking AI against 21 sarcoma centers from the ring trial
2025
·
Cheng-Peng Li
, Aimé Terence Kalisa
, et al.
·
Journal of Cancer Research and Clinical Oncology
·
14
PDF
Quantifying artificial intelligence through algorithmic generalization
2025
·
Takuya Ito
, Murray Campbell
, et al.
·
Nature Machine Intelligence
·
14
PDF
Show more works
View as search
Works count:
282
Citation count:
1,816
Year
Topic
Type