Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization

Joint Authors

Wang, Guanhua
Ji, Hua
Kong, Dexin
Zhang, Na

Source

Mobile Information Systems

Issue

Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-17, 17 p.

Publisher

Hindawi Publishing Corporation

Publication Date

2020-01-31

Country of Publication

Egypt

No. of Pages

17

Main Subjects

Telecommunications Engineering

Abstract EN

Nowadays, the heterogeneity gap of different modalities is the key problem for cross-modal retrieval.

In order to overcome heterogeneity gaps, potential correlations of different modalities need to be mined.

At the same time, the semantic information of class labels is used to reduce the semantic gaps between different modalities data and realize the interdependence and interoperability of heterogeneous data.

In order to fully exploit the potential correlation of different modalities, we propose a cross-modal retrieval framework based on graph regularization and modality dependence (GRMD).

Firstly, considering the potential feature correlation and semantic correlation, different projection matrices are learned for different retrieval tasks, such as image query text (I2T) or text query image (T2I).

Secondly, utilizing the internal structure of original feature space constructs an adjacent graph with semantic information constraints which can make different labels of heterogeneous data closer to the corresponding semantic information.

The experimental results on three widely used datasets demonstrate the effectiveness of our method.

American Psychological Association (APA)

Wang, Guanhua& Ji, Hua& Kong, Dexin& Zhang, Na. 2020. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems،Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1192374

Modern Language Association (MLA)

Wang, Guanhua…[et al.]. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems No. 2020 (2020), pp.1-17.
https://search.emarefa.net/detail/BIM-1192374

American Medical Association (AMA)

Wang, Guanhua& Ji, Hua& Kong, Dexin& Zhang, Na. Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization. Mobile Information Systems. 2020. Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1192374

Data Type

Journal Articles

Language

English

Notes

Includes bibliographical references

Record ID

BIM-1192374