Work

The Token Tax: Systematic Bias in Multilingual Tokenization

Year: 2026

Type: conference-paper

Abstract: Jessica M. Lundin, Ada Zhang, Nihal Karim, Hamza Louzan, Guohao Wei, David Ifeoluwa Adelani, Cody Carroll. Proceedings of the 7th Workshop on African Natural Language Processing (AfricaNLP 2026). 2026.

Source: Workshop on African Natural Language Processing (AfricaNLP)

DOI: 10.18653/v1/2026.africanlp-main.10

Authors: Jessica M. Lundin, Ada Zhang, Nihal Karim, Hamza Louzan, Guohao Wei, David Ifeoluwa Adelani, Cody Carroll

Institutions: Gates Foundation, Institute for Disease Modeling, University of San Francisco, Canadian Institute for Advanced Research, Mila - Quebec Artificial Intelligence Institute, McGill University

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

OpenAlex ID: W4415059154

FWCI: 17.87

Cites:

Cited by: 2

Related to: 10