Work

The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining

Year: 2026

Type: conference-paper

Abstract: Jiandong Shao, Raphael Tang, Crystina Zhang, Karin Sevegnani, Pontus Stenetorp, Jianfei Yang, Yao Lu. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.

Source: Proceedings of the conference - Association for Computational Linguistics. Meeting

DOI: 10.18653/v1/2026.acl-long.1706

Authors: Jiandong Shao, Raphael Tang, Crystina Zhang, Karin Sevegnani, Pontus Stenetorp, Jianfei Yang, Yao Lu

Institutions: Nanyang Technological University, University College London, University of Waterloo, Nvidia (United Kingdom), Nvidia (United States), National Institute of Informatics

Language: English

Topic: Topic Modeling

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: Nvidia, Government of the United Kingdom, UK Research and Innovation, University of Bristol, Science and Technology Facilities Council

Award: G963556061

OpenAlex ID: W7166877696

FWCI:

Cites:

Cited by:

Related to: 10