Product
Help
Pricing
About
Jobs
Log in
Get started
Keyword
Add to collection
multilingual benchmark
Description:
A multilingual benchmark is an evaluation dataset or task designed to measure system performance across multiple languages.
Primary topic:
Topic Modeling (32%)
Related topics:
Topic Modeling (32%),
Natural Language Processing Techniques (15%),
Multimodal Machine Learning Applications (11%)
OpenAlex ID:
keywords/multilingual-benchmark
Mixtral of Experts
2024
·
Jiang, Albert Q.
, Sablayrolles, Alexandre
, et al.
·
arXiv (Cornell University)
·
4,798
PDF
LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
2024
·
Yushi Bai
, Xin Lv
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
2,045
Cross-lingual Name Tagging and Linking for 282 Languages
2017
·
Xiaoman Pan
, Boliang Zhang
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
672
PDF
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
2024
·
Lucas Bandarkar
, Davis Liang
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
476
PDF
Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models
2023
·
Orevaoghene Ahia
, Sachin Kumar
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
320
PDF
BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages
2024
·
Junho Myung
, Nayeon Lee
, et al.
·
neural information processing systems
·
306
PDF
MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark
2021
·
Haoran Li
, Abhinav Arora
, et al.
·
Conference of the European Chapter of the Association for Computational Linguistics
·
265
PDF
EuroLLM: Multilingual Language Models for Europe
2025
·
Pedro Henrique Martins
, Patrick Fernandes
, et al.
·
Procedia Computer Science
·
218
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models
2020
·
Zhengbao Jiang
, Antonios Anastasopoulos
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
193
PDF
CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark
2024
·
David Romero
, Chenyang Lyu
, et al.
·
neural information processing systems
·
181
PDF
Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark
2021
·
Joel Niklaus
, Ilias Chalkidis
, et al.
·
Natural Legal Language Processing Workshop (NLLP)
·
165
PDF
MedExpQA: Multilingual benchmarking of Large Language Models for Medical Question Answering
2024
·
Iñigo Alonso
, Maite Oronoz
, et al.
·
Artificial Intelligence in Medicine
·
153
XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
2024
·
Mohammad Abdullah Matin Khan
, M Saiful Bari
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
123
PDF
MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
2026
·
Jaap Jumelet
, Leonie Weissweiler
, et al.
·
Transactions of the Association for Computational Linguistics
·
108
PDF
A Primer on Pretrained Multilingual Language Models
2025
·
Sumanth Doddapaneni
, Gowtham Ramesh
, et al.
·
ACM Computing Surveys
·
107
PDF
AfroBench: How Good are Large Language Models on African Languages?
2025
·
Jessica Ojo
, Odunayo Ogundepo
, et al.
·
Findings of the Association for Computational Linguistics: ACL (Findings of ACL)
·
107
PDF
LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain
2023
·
Joel Niklaus
, Veton Matoshi
, et al.
·
Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP)
·
105
PDF
PolyGuard: A Multilingual Safety Moderation Tool for 17 Languages
2025
·
Kumar, Priyanshu
, Jain, Devansh
, et al.
·
arXiv (Cornell University)
·
104
PDF
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation
2025
·
Weihao Xuan
, Rui Yang
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
99
PDF
xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
2023
·
Khan, Mohammad Abdullah Matin
, Bari, M Saiful
, et al.
·
arXiv (Cornell University)
·
99
PDF
Salamandra Technical Report
2025
·
Gonzalez-Agirre, Aitor
, Pàmies, Marc
, et al.
·
arXiv (Cornell University)
·
97
PDF
XL-WiC: A Multilingual Benchmark for Evaluating Semantic Contextualization
2020
·
Alessandro Raganato
, Tommaso Pasini
, et al.
·
Conference on Empirical Methods in Natural Language Processing (EMNLP)
·
96
PDF
MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation
2025
·
Xuan, Weihao
, Yang, Rui
, et al.
·
arXiv (Cornell University)
·
92
PDF
FairLex: A Multilingual Benchmark for Evaluating Fairness in Legal Text Processing
2022
·
Ilias Chalkidis
, Tommaso Pasini
, et al.
·
Proceedings of the conference - Association for Computational Linguistics. Meeting
·
91
IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages
2022
·
Bugliarello, Emanuele
, Liu, Fangyu
, et al.
·
TUbilio (Technical University of Darmstadt)
·
89
PDF
Show more works
View as search
Works count:
437
Citation count:
14,100
Year
Topic
Type