Work

Predicting LLM Inference Server Request Capacity

Year: 2025

Type: conference-paper

Source: IEEE High Performance Extreme Computing Conference

DOI: 10.1109/hpec67600.2025.11196629

Authors: Daniel J. Burrill, LaToya Anderson, William Arcand, David Bestor, William Bergeron, Alex Bonn, Chansup Byun, Michael Houle, Matthew Hubbell, Michael Jones, Piotr Luszczek, Peter Michaleas, Guillermo Morales, Julie Mullen, Andrew Prout, Albert Reuther, Antonio Rosa, Charles Yee, Vijay Gadepally

Institutions: MIT Lincoln Laboratory, Massachusetts Institute of Technology

Language: English

Topic: Advanced Queuing Theory Analysis

Subfield: Management Information Systems

Field: Business, Management and Accounting

Domain: Social Sciences

Open Access status: closed

OpenAlex ID: W4415250873

FWCI:

Cites:

Cited by:

Related to: