Work

Importance weighted variational graph autoencoder

Year: 2025
Type: article
Abstract: Variational Graph Autoencoder (VGAE) is a widely explored model for learning the distribution of graph data. Currently, the approximate posterior distribution in VGAE-based methods is overly restrictive, leading to a significant gap between the variational lower bound and the log-likelihood of graph data. This limitation reduces the expressive power of these VGAE-based models. To address this issue, this paper proposes the Importance Weighted Variational Graph Autoencoder (IWVGAE) and provides a theoretical justification. This method makes the posterior distribution more flexible through Monte Carlo sampling and assigns importance weights to the likelihood gradients during backpropagation. In this way, IWVGAE achieves a more flexible optimization objective, enabling the learning of richer latent representations for graph data. It not only achieves a theoretically tighter variational lower bound but also makes graph density estimation more accurate. Extensive experimental results on seven classic graph datasets show that as the number of samples from the approximate posterior distribution increases, (1) the variational lower bound continuously improves, validating the proposed theory, and (2) the performance on downstream tasks significantly improves, demonstrating more effective learning and representation of graph data.
Language: English
Open Access status: gold
Estimated APC paid: $2,490
OpenAlex ID: W4416892976
FWCI: 0.831
Cites: 21
Cited by: 2
Related to: