Work

Novel Loss Functions for Improved Data Visualization in t-SNE

Year: 2026

Type: article

Abstract: A popular method for projecting high-dimensional data onto a lower-dimensional space while preserving the integrity of its structure is t-distributed Stochastic Neighbor Embedding (t-SNE). This technique minimizes the Kullback–Leibler (KL) divergence to align the similarities between points in the original and reduced spaces. While t-SNE is highly effective, it prioritizes local neighborhood preservation, which results in limited separation between distant clusters and inadequate representation of global relationships. To improve these limitations, this work introduces two complementary approaches: (1) The Max-Flipped KL Divergence (KLmax) modifies the original divergence by incorporating a contrastive term, KL′, which enhances the ranking of point similarities through maximum similarity constraints. (2) The KL-Wasserstein Loss (LKL−W) combines the KL divergence with the classic Wasserstein distance, allowing the embedding to benefit from the smooth and geometry-aware transport properties of Wasserstein metrics. Experimental results show that these methods lead to improved separation and better structural clarity in the low-dimensional space compared to standard t-SNE.

Source: Machine Learning and Knowledge Extraction

DOI: 10.3390/make8020047

Authors: Sara Nassar, Rachid Hedjam, Samir Brahim Belhaouari

Institutions: Hamad bin Khalifa University, Bishop's University

Language: English

Topic: Face and Expression Recognition

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $2,172

Funder: Qatar National Research Fund