Work

A GPU-specialized Inference Parameter Server for Large-Scale Deep Recommendation Models

Year: 2022
Type: conference-paper
Abstract: Recommendation systems are of crucial importance for a variety of modern apps and web services, such as news feeds, social networks, e-commerce, search, etc. To achieve peak prediction accuracy, modern recommendation models combine deep learning with terabyte-scale embedding tables to obtain a fine-grained representation of the underlying data. Traditional inference serving architectures require deploying the whole model to standalone servers, which is infeasible at such massive scale.
Language: English
Open Access status: hybrid
OpenAlex ID: W4296591836
FWCI: 3.79
Cites: 27
Cited by: 22
Related to: 10