Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
agent benchmarks
Description:
Evaluation tasks and environments used to measure the capabilities and performance of autonomous software agents, including agents that interact with websites.
Related topics:
AI-based Problem Solving and Planning (16%),
Artificial Intelligence in Healthcare and Education (8%)
OpenAlex ID:
keywords/agent-benchmarks
AI Agents That Matter
2024
·
Kapoor, Sayash
, Stroebl, Benedikt
, et al.
·
arXiv (Cornell University)
·
471
PDF
REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
2025
·
Div Garg
, Diego Caples
, et al.
·
neural information processing systems
·
57
PDF
T1: A Tool-Oriented Conversational Dataset for Multi-Turn Agentic Planning
2025
·
Amartya Chakraborty
, Paresh Dashore
, et al.
·
neural information processing systems
·
22
PDF
Can Generalist Agents Automate Data Curation?
2026
·
Feiyang Kang
, Hanze Li
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
11
PDF
Agentic Ai - the Rise of Autonomous Intelligent Agents in the Era of Llms
2025
·
Sai Teja Erukude
, Suhasnadh Reddy Veluru
, et al.
·
Indian Journal of Computer Science and Engineering
·
9
AgentEHR: Advancing Autonomous Clinical Decision-Making via Retrospective Summarization
2026
·
Yusheng Liao
, Chuan Xuan
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
8
PDF
RealClawBench: Live OpenClaw Benchmarks from Real Developer-Agent Sessions
2026
·
Zongwei Lv
, Yaoming Li
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
4
PDF
Do Agent Benchmarks Do What They Say? An Executable-Contract Audit of Tool-Using Agent Environments
2026
·
Bellibatlu, Rohith Reddy
, Wang, Zichong
, et al.
·
arXiv (Cornell University)
·
3
PDF
ZipBench: Low-Cost Framework for Compressing Comprehensive Benchmarks of Large Language Models
2026
·
Zhongzhan Huang
, Junxin Li
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
3
PDF
PTCG-Bench: Can LLM Agents Master Pokémon Trading Card Game?
2026
·
Dongdong Hua
, Yifei Sun
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
2
PDF
SkillFusion: Towards Reliable Multi-Skill Composition for LLM Agents
2026
·
Huang, Enhao
, Zhao, Xinye
, et al.
·
arXiv (Cornell University)
·
1
PDF
TrajLong: Co-Designing Agentic and Long-Context Supervision for Mid-Training
2026
·
Peng, Miao
, Zhang, Qintong
, et al.
·
arXiv (Cornell University)
·
1
PDF
UserProxyBench: Evaluating LLM User Simulators for Agent Benchmarks and Training
2026
·
Jain, Ashish
, Sandhu, Armaan
·
arXiv (Cornell University)
·
1
PDF
The Temporal Coherence Problem: Synthetic Point-in-Time Environments for Evaluating LLM Agents with Dynamic Tool Dependencies
2026
·
Danish N. Shaikh
·
International Journal of Computer Applications
·
1
PDF
The Hard Part Comes After Search: Benchmarking Web Agents on Synthesizing, Organizing, and Displaying Knowledge
2026
·
Alexander Gill
, Md Farhan Ishmam
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
1
PDF
Agentic AI: A Review and Proposed Framework
2026
·
Ronit Raj Sharma
, Abhijeet Kumar
, et al.
·
International Journal for Research in Applied Science and Engineering Technology
PDF
AnalogLayoutWorld: An Open Benchmark for Agentic Analog Layout Design
2026
·
NovaSilicon Team
·
arXiv (Cornell University)
PDF
Intent-Aware Protection for AI Agents
2026
·
Copty, Fady
, Haiby, Neta
, et al.
·
arXiv (Cornell University)
PDF
Beyond Accuracy: A Critical Review of Evaluation, Clinical Validation, and Safety Frameworks for Agentic AI in Medicine
2026
·
James C. L. Chow
, Kay Li
·
Information
Random Is Almost Enough? Stable and Low-Cost Benchmark Compression via BestRand
2026
·
Ling, George
, Zhong, Shanshan
, et al.
·
arXiv (Cornell University)
PDF
THReD Agent Benchmark: Evaluation of an LLM Agent for Preprocessing Electronic Health Records into AI-Ready Datasets
2026
·
Mohammad Alizadeh, Javad
, Wu, Huanmei
·
Zenodo (CERN European Organization for Nuclear Research)
THReD Agent Benchmark: Evaluation of an LLM Agent for Preprocessing Electronic Health Records into AI-Ready Datasets
2026
·
Mohammad Alizadeh, Javad
, Wu, Huanmei
·
Zenodo (CERN European Organization for Nuclear Research)
$Δτ$-Bench: Pushing Agents Toward a Moving Capability
2026
·
Qiao, Shuofei
, Pan, Xuanguang
, et al.
·
arXiv (Cornell University)
PDF
DeepSWE Paired Failure Reads
2026
·
SIM, Kim Sia
, JIANG, Lingxiao
·
Zenodo (CERN European Organization for Nuclear Research)
benchmark-latency-budget
2026
·
Arab, Pooria
·
Zenodo (CERN European Organization for Nuclear Research)
Show more works
View as search
Works count:
36
Citation count:
595
Year
Topic
Type