Keyword

BPE tokenization

Description: A natural language processing method that segments text into subword units by iteratively merging frequent character sequences.
OpenAlex ID: keywords/bpe-tokenization
2019 · Nathan Ng, Kyra Yee, et al. · Conference on Machine Translation (WMT) · 464
2021 · Park, Sungjoon, Moon, Jihyung, et al. · arXiv (Cornell University) · 303
2023 · Sathvik Nair, Philip Resnik · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 39
2024 · Marco Cognetta, Vilém Zouhar, et al. · Language Resources and Evaluation Conference (LREC) · 36
2021 · Yuning Kang, Zan Wang, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 32
2024 · Kirill Vishniakov, Karthik Viswanathan, et al. · bioRxiv (Cold Spring Harbor Laboratory) · 21
2025 · Hayase, Jonathan, Liu, Alisa, et al. · arXiv (Cornell University) · 16
2022 · Dipesh Kumar, Avijit Thawani · Workshop on Insights from Negative Results in NLP (Insights) · 13
2019 · Dhananjaya Gowda, Abhinav Garg, et al. · Interspeech (USB) · 12
2026 · Konstantinos Mamouras, Angela W. Li, et al. · Proceedings of the ACM on Programming Languages · 8
2024 · Wenbo Li, Guohao Li, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 7
2026 · Smith, Jimmy T. H., Dakhran, Tarek, et al. · arXiv (Cornell University) · 6
2022 · Wenjie Hao, Hongfei Xu, et al. · Communications in computer and information science · 6
2020 · Watanabe, Shinji · Zenodo (CERN European Organization for Nuclear Research) · 6
2024 · Wu, Hengkui, Chi, Panpan, et al. · arXiv (Cornell University) · 5
2024 · Darwinkel, Patrick · arXiv (Cornell University) · 5
2019 · Shivachi Casper Shikali, Mokhosi Refuoe · Figshare · 5
2026 · Sun, Yike, Yang, Haotong, et al. · arXiv (Cornell University) · 4
2022 · Badr Jaidi, Utkarsh Saboo, et al. · Workshop on Multilingual Representation Learning (MRL) · 4
2022 · Alexander Molchanov, Vladislav Kovalenko, et al. · Conference on Machine Translation (WMT) · 4
2025 · Rareș Păpușoi, Sergiu Nisioi · BabyLM Workshop · 3
2025 · Zhao, Zeyu, Wang, Ningtao, et al. · arXiv (Cornell University) · 2
2025 · Nancy Hamdan, Osama Rakan Al Mraikhat, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 2
Works count: 164
Citation count: 1,105
Year
Topic
Type