Keyword

inference throughput

Description: Inference throughput is the number of model prediction requests or inputs processed per unit of time.
Primary topic: Topic Modeling (26%)
OpenAlex ID: keywords/inference-throughput
2023 · Woosuk Kwon, Zhuohan Li, et al. · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · 10,855
2023 · Jierun Chen, Shiu-hong Kao, et al. · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · 3,236
2024 · Lianmin Zheng, Liangsheng Yin, et al. · neural information processing systems · 2,211
2023 · Zhenyu Zhang, Ying Sheng, et al. · neural information processing systems · 1,903
2022 · Reza Yazdani Aminabadi, Samyam Rajbhandari, et al. · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · 841
2023 · Zichang Liu, Aditya Desai, et al. · neural information processing systems · 598
2023 · Liu, Zechun, Oguz, Barlas, et al. · arXiv (Cornell University) · 416
2023 · Agrawal, Amey, Panwar, Ashish, et al. · arXiv (Cornell University) · 390
2025 · Wu, Chengyue, Zhang, Hao, et al. · arXiv (Cornell University) · 365
2025 · Bercovich, Akhiad, Levy, Itay, et al. · arXiv (Cornell University) · 254
2024 · Arora, Simran, Eyuboglu, Sabri, et al. · arXiv (Cornell University) · 246
2024 · Akide Liu, Jing Liu, et al. · neural information processing systems · 245
2024 · Kang, Hao, Zhang, Qingru, et al. · arXiv (Cornell University) · 237
2024 · Dongjie Yang, Xiaodong Han, et al. · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · 225
2024 · Matanel Oren, Michael Hassid, et al. · Conference on Empirical Methods in Natural Language Processing (EMNLP) · 206
2024 · Yutao Sun, Li Dong, et al. · neural information processing systems · 199
2023 · Zangwei Zheng, Xiaozhe Ren, et al. · neural information processing systems · 179
2023 · Yunho Jin, Chun-Feng Wu, et al. · neural information processing systems · 162
2021 · Amirali Boroumand, Saugata Ghose, et al. · International Conference on Parallel Architectures and Compilation Techniques (PACT) · 153
2025 · Yixuan Mei, Yonghao Zhuang, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 147
2021 · Sneha Kudugunta, Yanping Huang, et al. · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · 141
2024 · Albert Tseng, Qingyao Sun, et al. · neural information processing systems · 131
2022 · Mengshu Sun, Zhengang Li, et al. · ACM/SIGDA International Symposium on Field-Programmable Gate Arrays (FPGA) · 131
2024 · Haoyi Wu, Kewei Tu · Proceedings of the conference - Association for Computational Linguistics. Meeting · 111
Works count: 1,324
Citation count: 32,730
Year
Topic
Type