Work

Learning Effective and Interpretable Semantic Models using Non-Negative Sparse Embedding

Year: 2012
Type: conference-paper
Abstract: In this paper, we introduce an application of matrix factorization to produce corpus-derived, distributional models of semantics that demonstrate cognitive plausibility. We find that word representations learned by Non-Negative Sparse Embedding (NNSE), a variant of matrix factorization, are sparse, effective, and highly interpretable. To the best of our knowledge, this is the first approach which yields semantic representation of words satisfying these three desirable properties. Though extensive experimental evaluations on multiple real-world tasks and datasets, we demonstrate the superiority of semantic models learned by NNSE over other state-of-the-art baselines.
Language: English
Open Access status: green
OpenAlex ID: W810147176
FWCI: 3.956
Cites: 45
Cited by: 147
Related to: 10