Combining Convolutional Neural Network and Markov Random Field for Semantic Image Retrieval
Joint Authors
Xu, Haijiao
Huang, Changqin
Huang, Xiaodi
Xu, Chunyan
Huang, Muxiong
Source
Issue
Vol. 2018, Issue 2018 (31 Dec. 2018), pp.1-11, 11 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2018-08-01
Country of Publication
Egypt
No. of Pages
11
Main Subjects
Information Technology and Computer Science
Abstract EN
With the rapidly growing number of images over the Internet, efficient scalable semantic image retrieval becomes increasingly important.
This paper presents a novel approach for semantic image retrieval by combining Convolutional Neural Network (CNN) and Markov Random Field (MRF).
As a key step, image concept detection, that is, automatically recognizing multiple semantic concepts in an unlabeled image, plays an important role in semantic image retrieval.
Unlike previous work that uses single-concept classifiers one by one, we detect semantic multiconcept by using a multiconcept scene classifier.
In other words, our approach takes multiple concepts as a holistic scene for multiconcept scene learning.
Specifically, we first train a CNN as a concept classifier, which further includes two types of classifiers: a single-concept fully connected classifier that is best suited to single-concept detection and a multiconcept scene fully connected classifier that is good for holistic scene detection.
Then we propose an MRF-based late fusion approach that is able to effectively learn the semantic correlation between the single-concept classifier and multiconcept scene classifier.
Finally, the semantic correlation among the subconcepts of images is cought to further improve detection precision.
In order to investigate the feasibility and effectiveness of our proposed approach, we conduct comprehensive experiments on two publicly available image databases.
The results show that our proposed approach outperforms several state-of-the-art approaches.
American Psychological Association (APA)
Xu, Haijiao& Huang, Changqin& Huang, Xiaodi& Xu, Chunyan& Huang, Muxiong. 2018. Combining Convolutional Neural Network and Markov Random Field for Semantic Image Retrieval. Advances in Multimedia،Vol. 2018, no. 2018, pp.1-11.
https://search.emarefa.net/detail/BIM-1118460
Modern Language Association (MLA)
Xu, Haijiao…[et al.]. Combining Convolutional Neural Network and Markov Random Field for Semantic Image Retrieval. Advances in Multimedia No. 2018 (2018), pp.1-11.
https://search.emarefa.net/detail/BIM-1118460
American Medical Association (AMA)
Xu, Haijiao& Huang, Changqin& Huang, Xiaodi& Xu, Chunyan& Huang, Muxiong. Combining Convolutional Neural Network and Markov Random Field for Semantic Image Retrieval. Advances in Multimedia. 2018. Vol. 2018, no. 2018, pp.1-11.
https://search.emarefa.net/detail/BIM-1118460
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1118460