Matrix Variate Gaussian Mixture Distribution Steered Robust Metric Learning
Year: 2018
Type: conference-paper
Abstract: Mahalanobis Metric Learning (MML) has been actively studied recently in machine learning community. Most of existing MML methods aim to learn a powerful Mahalanobis distance for computing similarity of two objects. More recently, multiple methods use matrix norm regularizers to constrain the learned distance matrixMto improve the performance. However, in real applications, the structure of the distance matrix M is complicated and cannot be characterized well by the simple matrix norm. In this paper, we propose a novel robust metric learning method with learning the structure of the distance matrix in a new and natural way. We partition M into blocks and consider each block as a random matrix variate, which is fitted by matrix variate Gaussian mixture distribution. Different from existing methods, our model has no any assumption on M and automatically learns the structure of M from the real data, where the distance matrix M often is neither sparse nor low-rank. We design an effective algorithm to optimize the proposed model and establish the corresponding theoretical guarantee. We conduct extensive evaluations on the real-world data. Experimental results show our method consistently outperforms the related state-of-the-art methods.
Authors: Lei Luo, Heng Huang
Institution: University of Pittsburgh
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
Awards: ABI Innovation: A New Automated Data Integration, Annotations, and Interaction Network Inference System for Analyzing Drosophila Gene Expression, III: Medium: Collaborative Research: Robust Large-Scale Electronic Medical Record Data Mining Framework to Conduct Risk Stratification for Personalized Intervention, G5520316217, BIGDATA: Collaborative Research: IA: Big Imaging-Omics Data Mining Framework for Precision Medicine, III: Small: Robust Large-Scale Data Mining for Knowledge Discovery in Depression Thought Records, SCH: EXP: Collaborative Research: Privacy-Preserving Framework for Publishing Electronic Healthcare Records, G9000211028, G9000243647
OpenAlex ID: W2788101503
