Year: 2018
Type: conference-paper
Abstract: We approach the problem of generalizing pretrained word embeddings beyond fixed-size vocabularies without using additional contextual information.We propose a subwordlevel word vector generation model that views words as bags of character n-grams.The model is simple, fast to train and provides good vectors for rare or unseen words.Experiments show that our model achieves stateof-the-art performances in English word similarity task and in joint prediction of part-ofspeech tag and morphosyntactic attributes in 23 languages, suggesting our model's ability in capturing the relationship between words' textual representations and their embeddings.
DOI: 10.18653/v1/d18-1059
Authors: Jinman Zhao, Sidharth Mudgal, Yingyu Liang
Institution: University of Wisconsin–Madison
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W2891680269
