Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
benchmark tasks
Description:
Standardized tasks used to evaluate and compare the capabilities or performance of methods, agents, or systems.
Related topics:
Usability and User Interface Design (11%),
Reinforcement Learning in Robotics (9%)
OpenAlex ID:
keywords/benchmark-tasks
Message Understanding Conference-6: a brief history
1996
·
Ralph Grishman
, Beth Sundheim
·
International Conference on Computational Linguistics
·
1,957
PDF
Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
2023
·
Mirac Suzgun
, Nathan Scales
, et al.
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
1,304
PDF
Orbit: A Unified Simulation Framework for Interactive Robot Learning Environments
2023
·
Mayank Mittal
, Calvin Yu
, et al.
·
IEEE Robotics and Automation Letters
·
733
PDF
Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text
2018
·
Haitian Sun
, Bhuwan Dhingra
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
716
PDF
dm_control: Software and tasks for continuous control
2020
·
Saran Tunyasuvunakool
, Alistair Muldal
, et al.
·
Software Impacts
·
596
PDF
OpenAGI: When LLM Meets Domain Experts
2023
·
Yingqiang Ge
, Wenyue Hua
, et al.
·
neural information processing systems
·
458
PDF
Mapillary Street-Level Sequences: A Dataset for Lifelong Place Recognition
2020
·
Frederik Warburg
, Soren Hauberg
, et al.
·
IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
·
361
MIMIC-Extract: a data extraction, preprocessing, and representation pipeline for MIMIC-III
2020
·
Shirly Wang
, Matthew B. A. McDermott
, et al.
·
ACM Conference on Health, Inference, and Learning (CHIL)
·
290
F1TENTH: An Open-source Evaluation Environment for Continuous Control and Reinforcement Learning
2019
·
Matthew O’Kelly
, Hongrui Zheng
, et al.
·
272
A Hand-Centric Classification of Human and Robot Dexterous Manipulation
2012
·
Ian M. Bullock
, Raymond R. Ma
, et al.
·
IEEE Transactions on Haptics
·
233
SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Driving
2020
·
Zhou, Ming
, Luo, Jun
, et al.
·
arXiv (Cornell University)
·
214
PDF
Mat - Multi-attribute Task Battery for Human Operator Workload and Strategic Behavior Research
1994
·
James R. Comstock
·
NASA Technical Reports Server (NASA)
·
210
Benchmarking Reinforcement Learning Algorithms on Real-World Robots
2018
·
Mahmood, A. Rupam
, Korenkevych, Dmytro
, et al.
·
arXiv (Cornell University)
·
181
PDF
Dexterous Aerial Robots—Mobile Manipulation Using Unmanned Aerial Systems
2017
·
Matko Orsag
, Christopher Korpela
, et al.
·
IEEE Transactions on Robotics
·
169
SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversations
2021
·
Satwik Kottur
, Seungwhan Moon
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
137
PDF
Overview of ImageCLEF 2018 Medical Domain Visual Question Answering Task.
2018
·
Sadid A. Hasan
, Ling Yuan
, et al.
·
ArODES (HES-SO (https://www.hes-so.ch/))
·
128
PDF
An empirical comparison of menu-selection (((CUI) and desktop (GUI) computer programs carried out by beginners and experts
1992
·
MATTHIAS RAUTERBERG
·
Behaviour and Information Technology
·
125
GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs
1995
·
David E. Kieras
, Scott D. Wood
, et al.
·
ACM Symposium on User Interface Software and Technology (UIST)
·
117
PDF
OmniDrones: An Efficient and Flexible Platform for Reinforcement Learning in Drone Control
2024
·
Botian Xu
, Feng Gao
, et al.
·
IEEE Robotics and Automation Letters
·
107
CGLB: Benchmark Tasks for Continual Graph Learning
2022
·
Xikun Zhang
, Dongjin Song
, et al.
·
neural information processing systems
·
91
Teamwork with Limited Knowledge of Teammates
2013
·
Samuel Barrett
, Peter Stone
, et al.
·
Proceedings of the AAAI Conference on Artificial Intelligence
·
86
Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
2016
·
Ji He
, Mari Ostendorf
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
78
PDF
Reconfigurable reservoir computing in a magnetic metamaterial
2023
·
I. T. Vidamour
, C. Swindells
, et al.
·
Communications Physics
·
66
PDF
On the contributions of different empirical data in usability testing
2000
·
Maria R. Ebling
, Bonnie E. John
·
Designing Interactive Systems Conference
·
66
Overview of the NTCIR-11 IMine Task
2014
·
Yiqun Liu
, Ruihua Song
, et al.
·
NTCIR
·
65
Show more works
View as search
Works count:
273
Citation count:
10,980
Year
Topic
Type