Abstraction and Association: Cross-Modal Retrieval Based on Consistency between Semantic Structures
المؤلفون المشاركون
Ren, Xiao-Guang
Yi, Liu
Zheng, Qibin
Qin, Wei
المصدر
Mathematical Problems in Engineering
العدد
المجلد 2020، العدد 2020 (31 ديسمبر/كانون الأول 2020)، ص ص. 1-17، 17ص.
الناشر
Hindawi Publishing Corporation
تاريخ النشر
2020-05-07
دولة النشر
مصر
عدد الصفحات
17
التخصصات الرئيسية
الملخص EN
Cross-modal retrieval aims to find relevant data of different modalities, such as images and text.
In order to bridge the modality gap, most existing methods require a lot of coupled sample pairs as training data.
To reduce the demands for training data, we propose a cross-modal retrieval framework that utilizes both coupled and uncoupled samples.
The framework consists of two parts: Abstraction that aims to provide high-level single-modal representations with uncoupled samples; then, Association links different modalities through a few coupled training samples.
Moreover, under this framework, we implement a cross-modal retrieval method based on the consistency between the semantic structure of multiple modalities.
First, both images and text are represented with the semantic structure-based representation, which represents each sample as its similarity from the reference points that are generated from single-modal clustering.
Then, the reference points of different modalities are aligned through an active learning strategy.
Finally, the cross-modal similarity can be measured with the consistency between the semantic structures.
The experiment results demonstrate that given proper abstraction of single-modal data, the relationship between different modalities can be simplified, and even limited coupled cross-modal training data are sufficient for satisfactory retrieval accuracy.
نمط استشهاد جمعية علماء النفس الأمريكية (APA)
Zheng, Qibin& Ren, Xiao-Guang& Yi, Liu& Qin, Wei. 2020. Abstraction and Association: Cross-Modal Retrieval Based on Consistency between Semantic Structures. Mathematical Problems in Engineering،Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1193886
نمط استشهاد الجمعية الأمريكية للغات الحديثة (MLA)
Zheng, Qibin…[et al.]. Abstraction and Association: Cross-Modal Retrieval Based on Consistency between Semantic Structures. Mathematical Problems in Engineering No. 2020 (2020), pp.1-17.
https://search.emarefa.net/detail/BIM-1193886
نمط استشهاد الجمعية الطبية الأمريكية (AMA)
Zheng, Qibin& Ren, Xiao-Guang& Yi, Liu& Qin, Wei. Abstraction and Association: Cross-Modal Retrieval Based on Consistency between Semantic Structures. Mathematical Problems in Engineering. 2020. Vol. 2020, no. 2020, pp.1-17.
https://search.emarefa.net/detail/BIM-1193886
نوع البيانات
مقالات
لغة النص
الإنجليزية
الملاحظات
Includes bibliographical references
رقم السجل
BIM-1193886
قاعدة معامل التأثير والاستشهادات المرجعية العربي "ارسيف Arcif"
أضخم قاعدة بيانات عربية للاستشهادات المرجعية للمجلات العلمية المحكمة الصادرة في العالم العربي
تقوم هذه الخدمة بالتحقق من التشابه أو الانتحال في الأبحاث والمقالات العلمية والأطروحات الجامعية والكتب والأبحاث باللغة العربية، وتحديد درجة التشابه أو أصالة الأعمال البحثية وحماية ملكيتها الفكرية. تعرف اكثر