Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization
Joint Authors
Wang, Guanhua
Ji, Hua
Kong, Dexin
Zhang, Na
Source
Issue
Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-17, 17 p.
Publisher
Hindawi Publishing Corporation
Publication Date
2020-01-31
Country of Publication
Egypt
No. of Pages
17
Main Subjects
Telecommunications Engineering
Abstract EN
Nowadays, the heterogeneity gap of different modalities is the key problem for cross-modal retrieval.
In order to overcome heterogeneity gaps, potential correlations of different modalities need to be mined.
At the same time, the semantic information of class labels is used to reduce the semantic gaps between different modalities data and realize the interdependence and interoperability of heterogeneous data.
In order to fully exploit the potential correlation of different modalities, we propose a cross-modal retrieval framework based on graph regularization and modality dependence (GRMD).
Firstly, considering the potential feature correlation and semantic correlation, different projection matrices are learned for different retrieval tasks, such as image query text (I2T) or text query image (T2I).
Secondly, utilizing the internal structure of original feature space constructs an adjacent graph with semantic information constraints which can make different labels of heterogeneous data closer to the corresponding semantic information.
The experimental results on three widely used datasets demonstrate the effectiveness of our method.
American Psychological Association (APA)
Wang, Guanhua& Ji, Hua& Kong, Dexin& Zhang, Na. 2020. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems،Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1192374
Modern Language Association (MLA)
Wang, Guanhua…[et al.]. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems No. 2020 (2020), pp.1-17.
https://search.emarefa.net/detail/BIM-1192374
American Medical Association (AMA)
Wang, Guanhua& Ji, Hua& Kong, Dexin& Zhang, Na. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems. 2020. Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1192374
Data Type
Journal Articles
Language
English
Notes
Includes bibliographical references
Record ID
BIM-1192374