Automatic Image Captioning Based on ResNet50 and LSTM with Soft Attention
Joint Authors
Yu, Lei
Chu, Yan
Yue, Xiao
Sergei, Mikhailov
Wang, Zhengkui
Source
Wireless Communications and Mobile Computing
Issue
Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-7, 7 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2020-10-21
Country of Publication
Egypt
No. of Pages
7
Main Subjects
Information Technology and Computer Science
Abstract EN
Captioning the images with proper descriptions automatically has become an interesting and challenging problem.
In this paper, we present one joint model AICRL, which is able to conduct the automatic image captioning based on ResNet50 and LSTM with soft attention.
AICRL consists of one encoder and one decoder.
The encoder adopts ResNet50 based on the convolutional neural network, which creates an extensive representation of the given image by embedding it into a fixed length vector.
The decoder is designed with LSTM, a recurrent neural network and a soft attention mechanism, to selectively focus the attention over certain parts of an image to predict the next sentence.
We have trained AICRL over a big dataset MS COCO 2014 to maximize the likelihood of the target description sentence given the training images and evaluated it in various metrics like BLEU, METEROR, and CIDEr.
Our experimental results indicate that AICRL is effective in generating captions for the images.
American Psychological Association (APA)
Chu, Yan& Yue, Xiao& Yu, Lei& Sergei, Mikhailov& Wang, Zhengkui. 2020. Automatic Image Captioning Based on ResNet50 and LSTM with Soft Attention. Wireless Communications and Mobile Computing،Vol. 2020, no. 2020, pp.1-7.
https://search.emarefa.net/detail/BIM-1214956
Modern Language Association (MLA)
Chu, Yan…[et al.]. Automatic Image Captioning Based on ResNet50 and LSTM with Soft Attention. Wireless Communications and Mobile Computing No. 2020 (2020), pp.1-7.
https://search.emarefa.net/detail/BIM-1214956
American Medical Association (AMA)
Chu, Yan& Yue, Xiao& Yu, Lei& Sergei, Mikhailov& Wang, Zhengkui. Automatic Image Captioning Based on ResNet50 and LSTM with Soft Attention. Wireless Communications and Mobile Computing. 2020. Vol. 2020, no. 2020, pp.1-7.
https://search.emarefa.net/detail/BIM-1214956
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1214956