Work

Parallel Image Captioning Using 2D Masked Convolution

Year: 2019
Type: article
Abstract: Automatically generating a novel description of an image is a challenging and important problem that brings together advanced research in both computer vision and natural language processing. In recent years, image captioning has significantly improved its performance by using long short-term memory (LSTM) as a decoder for the language model. However, despite this improvement, LSTM itself has its own shortcomings as a model because the structure is complicated and its nature is inherently sequential. This paper proposes a model using a simple convolutional network for both encoder and decoder functions of image captioning, instead of the current state-of-the-art approach. Our experiment with this model on a Microsoft Common Objects in Context (MSCOCO) captioning dataset yielded results that are competitive with the state-of-the-art image captioning model across different evaluation metrics, while having a much simpler model and enabling parallel graphics processing unit (GPU) computation during training, resulting in a faster training time.
Institution: Inha University
Language: English
Open Access status: gold
Estimated APC paid: $1,520
OpenAlex ID: W2944238902
FWCI: 0.178
Cites: 29
Cited by: 4
Related to: 10