Work

Activation Sequence Caching: High-Throughput and Memory-Efficient Generative Inference with a Single GPU

Year: 2024

Type: conference-paper

Source: International Conference on Parallel Architectures and Compilation Techniques

DOI: 10.1145/3656019.3676945

Authors: Sowoong Kim, Eunyeong Sim, Youngsam Shin, YeonGon Cho, Woongki Baek

Institutions: Ulsan National Institute of Science and Technology, Samsung (South Korea), Samsung Advanced Institute of Technology (South Korea)

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: closed

Funder: Universitas Brawijaya

Award: G7113188890

OpenAlex ID: W4403337152

FWCI: 0.935

Cites: 25

Cited by: 3

Related to: 10