Year: 2014
Type: paratext
Abstract: Vector space models implement the distributional hypothesis.They are based on the repetition of information occurring in the contexts of words to associate.However, these models suffer from a high number of dimensions and data sparsity in the matrix of contextual vectors.This is a major issue with specialised corpora that are of much smaller size and with much lower context frequencies.We tackle the problem of data sparsity on specialised texts and we propose a method that allows to make the matrix denser, by generalising and normalising distributional contexts.Generalisation gives better results with the Jaccard index, narrow sliding windows and relations of lexical inclusion.On the other hand, normalisation has no positive effect on the relation extraction, with any combination of distributional parameters.
DOI: 10.3115/v1/w14-48
Language: English
Subfield: Language and Linguistics
Field: Arts and Humanities
Domain: Social Sciences
Open Access status: gold
OpenAlex ID: W4244585889