Work

Issues in evaluating semantic spaces using word analogies

Year: 2016
Type: conference-paper
Abstract: The offset method for solving word analogies has become a standard evaluation tool for vector-space semantic models: it is considered desirable for a space to represent semantic relations as consistent vector offsets.We show that the method's reliance on cosine similarity conflates offset consistency with largely irrelevant neighborhood structure, and propose simple baselines that should be used to improve the utility of the method in vector space evaluation.
Author: Tal Linzen
Language: English
Open Access status: hybrid
OpenAlex ID: W2465912008
FWCI: 9.672
Cites: 17
Cited by: 195
Related to: 10