Keyword

subword tokenization

Description: A natural language processing method that splits text into word fragments used as tokens for language modeling and other computational tasks.
OpenAlex ID: keywords/subword-tokenization
2018 · Taku Kudo, John Richardson · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · 5,319
2021 · Nan Jiang, Thibaud Lutellier, et al. · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · 510
2023 · Aleksandar Petrov, Emanuele La Malfa, et al. · neural information processing systems · 489
2020 · Kaj Bostrom, Greg Durrett · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 452
2022 · Jonathan H. Clark, Dan Garrette, et al. · Transactions of the Association for Computational Linguistics · 426
2021 · Mielke, Sabrina J., Alyafeai, Zaid, et al. · arXiv (Cornell University) · 380
2021 · Nogueira, Rodrigo, Jiang, Zhiying, et al. · arXiv (Cornell University) · 183
2020 · Wentao Ma, Yiming Cui, et al. · International Conference on Computational Linguistics · 156
2013 · Aren Jansen, Emmanuel Dupoux, et al. · IEEE International Conference on Acoustics Speech and Signal Processing · 148
2024 · Wang, Junxiong, Gangavarapu, Tushaar, et al. · arXiv (Cornell University) · 112
2019 · Jasdeep Singh, Bryan McCann, et al. · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · 108
2019 · Ding, Shuoyang, Renduchintala, Adithya, et al. · arXiv (Cornell University) · 103
2023 · Piotr Nawrot, Jan Chorowski, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 101
2020 · Schick, Timo, Schütze, Hinrich · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · 97
2020 · Timo Schick, Hinrich Schütze · Proceedings of the AAAI Conference on Artificial Intelligence · 86
2023 · Miguel Domingo, Mercedes García-Martínez, et al. · Lecture notes in computer science · 84
2022 · Zaid Alyafeai, Maged S. Al-shaibani, et al. · Neural Processing Letters · 77
2021 · Vin Sachidananda, Jason Kessler, et al. · Workshop on Simple and Efficient Natural Language Processing (SustaiNLP) · 77
2021 · Pranaydeep Singh, Gorik Rutten, et al. · Joint SIGHUM Workshop on Computational Linguistics for Cultural Heritage, Social Sciences, Humanities and Literature (LaTeCH-CLfL) · 69
2024 · Yekun Chai, Yewei Fang, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 67
2025 · Asgari, Ehsaneddin, Kheir, Yassine El, et al. · arXiv (Cornell University) · 63
2024 · Kevin Slagle · neural information processing systems · 63
2018 · Liwei Hou, Po Hu, et al. · Lecture notes in computer science · 63
2019 · Meizhi Ju, Nhung T H Nguyen, et al. · Journal of the American Medical Informatics Association · 62
2025 · Benjamin Minixhofer, Ivan Vulić, et al. · neural information processing systems · 59
Works count: 754
Citation count: 13,210
Year
Topic
Type