Work

Learning Image Embeddings using Convolutional Neural Networks for Improved Multi-Modal Semantics

Year: 2014
Type: conference-paper
Abstract: We construct multi-modal concept representations by concatenating a skip-gram linguistic representation vector with a visual concept representation vector computed using the feature extraction layers of a deep convolutional neural network (CNN) trained on a large labeled object recognition dataset.This transfer learning approach brings a clear performance gain over features based on the traditional bag-of-visual-word approach.Experimental results are reported on the WordSim353 and MEN semantic relatedness evaluation tasks.We use visual features computed using either ImageNet or ESP Game images.
Language: English
Open Access status: hybrid
OpenAlex ID: W2145056192
FWCI: 10.47
Cites: 43
Cited by: 232
Related to: 10