Keyword

large language model serving

Description: The systems and techniques for delivering large language model inference to users or applications, including scheduling, batching, and resource management.
OpenAlex ID: keywords/large-language-model-serving
2023 · Woosuk Kwon, Zhuohan Li, et al. · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · 3,968
2024 · Xupeng Miao, Gabriele Oliaro, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 454
2025 · Jiayi Yao, Hanchen Li, et al. · European Conference on Computer Systems · 258
2024 · Yuhan Liu, Hanchen Li, et al. · ACM SIGCOMM Conference (SIGCOMM) · 242
2024 · Zhong, Yinmin, Liu, Shengyu, et al. · arXiv (Cornell University) · 213
2023 · Sheng, Ying, Cao, Shiyi, et al. · arXiv (Cornell University) · 199
2024 · Lin, Yujun, Tang, Haotian, et al. · arXiv (Cornell University) · 198
2023 · Zhao, Yilong, Lin, Chien-Yu, et al. · arXiv (Cornell University) · 193
2024 · Holmes, Connor, Tanaka, Masahiro, et al. · arXiv (Cornell University) · 158
2024 · Hu, Cunchen, Huang, Heyang, et al. · arXiv (Cornell University) · 136
2024 · Baolin Li, Yankai Jiang, et al. · IEEE High Performance Extreme Computing Conference · 116
2025 · Yixuan Mei, Yonghao Zhuang, et al. · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · 95
2025 · Lingfan Yu, Jinkun Lin, et al. · European Conference on Computer Systems · 80
2024 · He, Jiaao, Zhai, Jidong · arXiv (Cornell University) · 80
2025 · Zuo, Pengfei, Lin, Huimin, et al. · arXiv (Cornell University) · 78
2024 · Fenglong Cai, Dong Yuan, et al. · IEEE International Conference on Web Services (ICWS) · 68
2024 · Song, Xiaoniu, Zhong, Zihang, et al. · arXiv (Cornell University) · 64
2024 · Griggs, Tyler, Liu, Xiaoxuan, et al. · arXiv (Cornell University) · 61
2025 · Yang, Huan, Zhang, Renji, et al. · arXiv (Cornell University) · 58
2024 · Zhu, Kan, Gao, Yufei, et al. · arXiv (Cornell University) · 57
2024 · Archit Patke, Dhemath Reddy, et al. · ACM Symposium on Cloud Computing (SoCC) · 52
2024 · Wenqi Jiang, Marco Zeller, et al. · Proceedings of the VLDB Endowment · 51
2024 · Gao, Bin, He, Zhuomin, et al. · arXiv (Cornell University) · 51
2026 · Zikun Li, Zhuofu Chen, et al. · European Conference on Computer Systems · 50
2026 · Hanfei Yu, Xingqi Cui, et al. · European Conference on Computer Systems · 49
Works count: 549
Citation count: 8,916
Year
Topic
Type