Stochastic Low-Rank Subspace Clustering by Auxiliary Variable Modeling
Year: 2015
Type: preprint
Abstract: Low-Rank Representation (LRR) is a popular tool to identify the data that are generated by a union of subspaces. However, the size of the regularized matrix of LRR is proportional to n 2 , where n is the number of samples, which hinders LRR for large scale problems. In this paper, we study how to scale up the LRR method accurately and memory efficiently. In particular, we propose an online implementation that reduces the memory cost fromO(n 2 ) to O(pd), with p being the ambient dimension and d being some expected rank. There are two key techniques in our algorithm: one is to reformulate the nuclear norm to an equivalent matrix factorization form and the other is to introduce an auxiliary variable working as a basis dictionary of the underlying data, which combined together makes the problem amenable to stochastic optimization. We establish a theoretical guarantee that the sequence of solutions produced by our algorithm will converge to a stationary point asymptotically. Numerical experiments on subspace recovery and subspace clustering tasks demonstrate the efficacy and robu stness of the proposed algorithm.
Source: arXiv (Cornell University)
Language: English
Subfield: Signal Processing
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W1671942188