Offloading with prefetch-aware memory optimization: enabling efficient single-GPU inference for large language models
Year: 2025
Type: conference-paper
Source: IET conference proceedings.
Authors: Xinhao Wang, Hailong Quan
Institution: North China University of Technology
Language: English
Subfield: Hardware and Architecture
Field: Computer Science
Domain: Physical Sciences
Open Access status: closed
OpenAlex ID: W4415103180
FWCI:
Cites:
Cited by:
Related to:
