Work

Knowledge Graph Embedding Compression

Year: 2020
Type: conference-paper
Abstract: Knowledge graph (KG) representation learning techniques that learn continuous embeddings of entities and relations in the KG have become popular in many AI applications.With a large KG, the embeddings consume a large amount of storage and memory.This is problematic and prohibits the deployment of these techniques in many real world settings.Thus, we propose an approach that compresses the KG embedding layer by representing each entity in the KG as a vector of discrete codes and then composes the embeddings from these codes.The approach can be trained end-toend with simple modifications to any existing KG embedding technique.We evaluate the approach on various standard KG embedding evaluations and show that it achieves 50-1000x compression of embeddings with a minor loss in performance.The compressed embeddings also retain the ability to perform various reasoning tasks such as KG inference.
Language: English
Open Access status: hybrid
OpenAlex ID: W3034225346
FWCI: 1.377
Cites: 50
Cited by: 35
Related to: 10