Keyword

continuous batching

Description: A serving technique that dynamically adds and removes requests from batches during model inference to improve accelerator utilization and throughput.
OpenAlex ID: keywords/continuous-batching
2024 · Qiu, Haoran, Mao, Weichao, et al. · arXiv (Cornell University) · 119
2025 · Shubham Agarwal, Sai Sundaresan, et al. · Proceedings of the ACM on Management of Data · 92
2024 · Sungmin Yun, Kwanhee Kyung, et al. · IEEE/ACM International Symposium on Microarchitecture (MICRO) · 92
2025 · Eldar Kurtic, Alexandre Noll Marques, et al. · Proceedings of the conference - Association for Computational Linguistics. Meeting · 68
2025 · Yang, Huan, Zhang, Renji, et al. · arXiv (Cornell University) · 65
2023 · Sheng, Ying, Cao, Shiyi, et al. · arXiv (Cornell University) · 53
2025 · Ruihao Gong, Shihao Bai, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 50
2024 · Cheng, Ke, Hu, Wen, et al. · arXiv (Cornell University) · 20
2025 · Yandi Li, Jianxiong Guo, et al. · IEEE Transactions on Services Computing · 16
2026 · Ozgur Guldogan, Jackson Kunde, et al. · ACM Transactions on Modeling and Performance Evaluation of Computing Systems · 15
2026 · Li, Xiangyu, Tang, Huaizhi, et al. · arXiv (Cornell University) · 9
2026 · Md. Monzurul Amin Ifath, Israat Haque · Proceedings of the ACM on Measurement and Analysis of Computing Systems · 8
2026 · Wang, Tianyi, Fan, Huawei, et al. · arXiv (Cornell University) · 6
2026 · Ao, Ruicheng, Dong, Jing, et al. · arXiv (Cornell University) · 5
2026 · Xiaoxiao Jiang, Suyi Li, et al. · European Conference on Computer Systems · 5
2025 · Zhang, Mingda, Qin, Jianglong · arXiv (Cornell University) · 5
2024 · Bartosz Walkowiak, Tomasz Walkowiak · Lecture notes in networks and systems · 5
2026 · Fan, Qihang, Huang, Huaibo, et al. · arXiv (Cornell University) · 4
2026 · Luo, Qi, Li, Kunlin, et al. · arXiv (Cornell University) · 4
2026 · Yao, Xiteng, Kim, Taeho, et al. · arXiv (Cornell University) · 4
2024 · Kartheek Reddy Jinna · International Journal of Research Publications in Engineering Technology and Management · 4
2019 · Fei He, Zeyu Wang, et al. · IOP Conference Series Materials Science and Engineering · 4
2026 · Jonathan Li, Nasim Farahini, et al. · ISC High Performance (ISC) · 3
2026 · Fan, Qihang, Huang, Huaibo, et al. · arXiv (Cornell University) · 3
Works count: 102
Citation count: 717
Year
Topic
Type