Work

Energy Cost Modelling for Optimizing Large Language Model Inference on Hardware Accelerators

Year: 2024

Type: conference-paper

Source: IEEE International System-on-Chip Conference (SOCC)

DOI: 10.1109/socc62300.2024.10737844

Authors: Robin Geens, Man Shi, Arne Symons, Chao Fang, Marian Verhelst

Institution: KU Leuven

Language: English

Topic: Parallel Computing and Optimization Techniques

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

SDG: Affordable and clean energy

Open Access status: closed

Funders: KU Leuven, European Research Council

OpenAlex ID: W4404057367

FWCI: 3.728

Cites: 25

Cited by: 12

Related to: 10