Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
Year: 2025
Type: conference-paper
Abstract: Shivalika Singh, Angelika Romanou, Clémentine Fourrier, David Ifeoluwa Adelani, Jian Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Sebastian Ruder, Wei-Yin Ko, Antoine Bosselut, Alice Oh, Andre Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, Sara Hooker. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors: Shivalika Singh, Angelika Romanou, Clémentine Fourrier, David Ifeoluwa Adelani, Jian Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Sebastian Ruder, Wei-Yin Ko, Antoine Bosselut, Alice Oh, Andre Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, Sara Hooker
Institutions: Cohere (Canada), Hugging Face, École Polytechnique Fédérale de Lausanne, Canadian Institute for Advanced Research, McGill University, National University of Singapore, AI Singapore, Massachusetts Institute of Technology, Universidad de Buenos Aires, Korea Advanced Institute of Science and Technology, University of Lisbon, Instituto de Telecomunicações, Instituto Superior Técnico, IBM (United States), Carnegie Mellon University, Consejo Nacional de Investigaciones Científicas y Técnicas
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4412944984