A lightweight framework for knowledge graph representation learning models based on knowledge distillation strategy
Year: 2025
Type: article
Abstract: With the continuous expansion of traditional knowledge graph scales and deepening research, the design of models has become increasingly complex to enhance knowledge representation capabilities. This not only increases the required computational support but also brings significant computational and storage overheads, making deploying knowledge graphs to terminal devices a major challenge. To address the issues of high computational and storage costs of knowledge graph representation learning models, which are difficult to deploy on resource-constrained terminal devices, a model lightweighting framework based on knowledge distillation technology is thoroughly investigated and proposed. This framework employs a complex high-performance model as the teacher model and a low-dimensional model as the student model. With the assistance of the teacher, lightweighting of high-dimensional models can be achieved through training while minimizing loss of performance. Experiments with nine different models on four general datasets validate the scientific, effective, and practical nature of the proposed lightweighting framework.
Source: Complex & Intelligent Systems
Authors: Qiuhui Shen, Hongjun Zhang, Aiyan Qu, Shi Dong
Institutions: Zhoukou Normal University, Jinling Institute of Technology
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,490
OpenAlex ID: W4413901206