Keyword

speculative decoding

Description: An inference technique for language models that uses a draft model to propose tokens for verification by a larger target model.
Wikidata ID: wiki/Q139963345
OpenAlex ID: keywords/speculative-decoding
2024 · Cai, Tianle, Li, Yuhong, et al. · arXiv (Cornell University) · 1,027
2022 · Leviathan, Yaniv, Kalman, Matan, et al. · arXiv (Cornell University) · 613
2024 · Mostafa Elhoushi, Akshat Shrivastava, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 466
2024 · Heming Xia, Zhe Yang, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 402
2024 · Fu, Yichao, Bailis, Peter, et al. · arXiv (Cornell University) · 321
2025 · Seedream, Team, :, et al. · arXiv (Cornell University) · 317
2026 · Core Team, Xiao, Bangjun, et al. · arXiv (Cornell University) · 300
2024 · Zhenyu He, Zexuan Zhong, et al. · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · 294
2024 · Lee, Wonbeom, Lee, Jungi, et al. · arXiv (Cornell University) · 258
2023 · Heming Xia, Tao Ge, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 243
2023 · Sehoon Kim, Karttikeya Mangalam, et al. · neural information processing systems · 211
2023 · Spector, Benjamin, Re, Chris · arXiv (Cornell University) · 186
2023 · Gandhi, Sanchit, von Platen, Patrick, et al. · arXiv (Cornell University) · 184
2024 · Ankner, Zachary, Parthasarathy, Rishab, et al. · arXiv (Cornell University) · 175
2023 · Zhou, Yongchao, Lyu, Kaifeng, et al. · arXiv (Cornell University) · 170
2023 · Ziteng Sun, Ananda Theertha Suresh, et al. · neural information processing systems · 168
2024 · Junxiong Wang, Daniele Paliotta, et al. · neural information processing systems · 161
2026 · Chen, Jian, Liang, Yesheng, et al. · arXiv (Cornell University) · 156
2024 · Beurer-Kellner, Luca, Fischer, Marc, et al. · arXiv (Cornell University) · 151
2023 · Liu, Xiaoxuan, Hu, Lanxiang, et al. · arXiv (Cornell University) · 150
2024 · Sun, Hanshi, Chen, Zhuoming, et al. · arXiv (Cornell University) · 127
2024 · Chen, Zhuoming, May, Avner, et al. · arXiv (Cornell University) · 127
2025 · Liao, Baohao, Xu, Yuhui, et al. · arXiv (Cornell University) · 119
2025 · Daniel Israel, Guy Van den Broeck, et al. · neural information processing systems · 114
2024 · Wang, Junxiong, Gangavarapu, Tushaar, et al. · arXiv (Cornell University) · 112
Works count: 1,288
Citation count: 14,900
Year
Topic
Type