Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
AI benchmarks
Description:
Standardized tests, tasks, or evaluation frameworks used to measure and compare the capabilities of artificial intelligence systems.
Related topics:
Artificial Intelligence Applications (17%),
Ethics and Social Impacts of AI (14%)
OpenAlex ID:
keywords/ai-benchmarks
AI and the Everything in the Whole Wide World Benchmark
2021
·
Raji, Inioluwa Deborah
, Bender, Emily M.
, et al.
·
arXiv (Cornell University)
·
520
PDF
AI Benchmark: Running Deep Neural Networks on Android Smartphones
2019
·
Andrey Ignatov
, Radu Timofte
, et al.
·
Lecture notes in computer science
·
371
Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks
2021
·
Songül Tolan
, Annarosa Pesole
, et al.
·
Journal of Artificial Intelligence Research
·
254
PDF
BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices
2024
·
Anka Reuel
, Amelia Hardy
, et al.
·
neural information processing systems
·
246
PDF
Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation
2025
·
Maria Eriksson
, Erasmo Purificato
, et al.
·
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
·
185
PDF
Mapping global dynamics of benchmark creation and saturation in artificial intelligence
2022
·
Simon Ott
, Adriano Barbosa-Silva
, et al.
·
Nature Communications
·
181
PDF
Benchmarks for Automated Commonsense Reasoning: A Survey
2023
·
Ernest Davis
·
ACM Computing Surveys
·
144
PDF
Research community dynamics behind popular AI benchmarks
2021
·
Fernando Martínez-Plumed
, Pablo Barredo
, et al.
·
Nature Machine Intelligence
·
107
PDF
Does AI Qualify for the Job? A Bidirectional Model Mapping Labour and AI Intensities
2020
·
Fernando Martínez-Plumed
, Songül Tolan
, et al.
·
Proceedings of the AAAI/ACM Conference on AI Ethics and Society
·
90
Benchmark datasets driving artificial intelligence development fail to capture the needs of medical professionals
2022
·
Kathrin Blagec
, Jakob Kraiger
, et al.
·
Journal of Biomedical Informatics
·
84
PDF
AI Benchmark: Running Deep Neural Networks on Android Smartphones
2018
·
Ignatov, Andrey
, Timofte, Radu
, et al.
·
arXiv (Cornell University)
·
82
PDF
Games for Artificial Intelligence Research: A Review and Perspectives
2024
·
Chengpeng Hu
, Yunlong Zhao
, et al.
·
IEEE Transactions on Artificial Intelligence
·
75
PDF
Beyond the Turing Test
2016
·
Gary Marcus
, Francesca Rossi
, et al.
·
AI Magazine
·
70
PDF
GPT-4 in Education: Evaluating Aptness, Reliability, and Loss of Coherence in Solving Calculus Problems and Grading Submissions
2024
·
Alberto Gandolfi
·
International Journal of Artificial Intelligence in Education
·
69
PDF
A curated, ontology-based, large-scale knowledge graph of artificial intelligence tasks and benchmarks
2022
·
Kathrin Blagec
, Adriano Barbosa-Silva
, et al.
·
Scientific Data
·
66
PDF
When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
2026
·
Akhtar, Mubashara
, Reuel, Anka
, et al.
·
arXiv (Cornell University)
·
61
PDF
Artificial intelligence in paleontology
2024
·
Congyu Yu
, Fangbo Qin
, et al.
·
Earth-Science Reviews
·
55
A Rosetta Stone for AI Benchmarks
2025
·
Ho, Anson
, Denain, Jean-Stanislas
, et al.
·
arXiv (Cornell University)
·
47
PDF
AIBench: Towards trustworthy evaluation under the 45°law
2025
·
Zicheng Zhang
, Junying Wang
, et al.
·
Displays
·
46
The Turing Transformation: Artificial Intelligence, Intelligence Augmentation, and Skill Premiums
2023
·
Ajay Agrawal
, Joshua Gans
, et al.
·
National Bureau of Economic Research
·
46
PDF
Dual Indicators to Analyze AI Benchmarks: Difficulty, Discrimination, Ability, and Generality
2018
·
Fernando Martinez-Plumed
, Jose Hernandez-Orallo
·
IEEE Transactions on Games
·
45
PDF
KramaBench: A Benchmark for AI Systems on Data-to-Insight Pipelines over Data Lakes
2025
·
Lai, Eugenie
, Vitagliano, Gerardo
, et al.
·
International Conference on Learning Representations
·
37
More than Marketing? On the Information Value of AI Benchmarks for Practitioners
2025
·
Amelia Hardy
, Anka Reuel
, et al.
·
ACM International Conference on Intelligent User Interfaces (IUI)
·
37
PDF
TPCx-AI - An Industry Standard Benchmark for Artificial Intelligence and Machine Learning Systems
2023
·
Christoph Brücke
, Philipp Härtling
, et al.
·
Proceedings of the VLDB Endowment
·
36
AI now beats humans at basic tasks — new benchmarks are needed, says major report
2024
·
Nicola Jones
·
Nature
·
34
Show more works
View as search
Works count:
299
Citation count:
3,710
Year
Topic
Type