![](/images/graphics-bg.png)
DPAEG: A Dependency Parse-Based Adversarial Examples Generation Method for Intelligent Q&A Robots
المؤلفون المشاركون
Wang, Jian
Xue, Mingfu
Yuan, Chengxiang
Liu, Weiqiang
المصدر
Security and Communication Networks
العدد
المجلد 2020، العدد 2020 (31 ديسمبر/كانون الأول 2020)، ص ص. 1-15، 15ص.
الناشر
Hindawi Publishing Corporation
تاريخ النشر
2020-01-13
دولة النشر
مصر
عدد الصفحات
15
التخصصات الرئيسية
تكنولوجيا المعلومات وعلم الحاسوب
الملخص EN
Recently, the natural language processing- (NLP-) based intelligent question and answer (Q&A) robots have been used ubiquitously.
However, the robustness and security of current Q&A robots are still unsatisfactory, e.g., a slight typo in the user’s question may cause the Q&A robot unable to return the correct answer.
In this paper, we propose a fast and automatic test dataset generation method for the robustness and security evaluation of current Q&A robots, which can work in black-box scenarios and thus can be applied to a variety of different Q&A robots.
Specifically, we propose a dependency parse-based adversarial examples generation (DPAEG) method for Q&A robots.
DPAEG first uses the proposed dependency parse-based keywords extraction algorithm to extract keywords from a question.
Then, the proposed algorithm generates adversarial words according to the extracted keywords, which include typos and words that are spelled similarly to the keywords.
Finally, these adversarial words are used to generate a large number of adversarial questions.
The generated adversarial questions which are similar to the original questions do not affect human’s understanding, but the Q&A robots cannot answer these adversarial questions correctly.
Moreover, the proposed method works in a black-box scenario, which means it does not need the knowledge of the target Q&A robots.
Experiment results show that the generated adversarial examples have a high success rate on two state-of-the-art Q&A robots, DrQA and Google Assistant.
In addition, the generated adversarial examples not only affect the correct answer (top-1) returned by DrQA but also affect the top-k candidate answers returned by DrQA.
The adversarial examples make the top-k candidate answers contain fewer correct answers and make the correct answers rank lower in the top-k candidate answers.
The human evaluation results show that participants with different genders, ages, and mother tongues can understand the meaning of most of the generated adversarial examples, which means that the generated adversarial examples do not affect human’s understanding.
نمط استشهاد جمعية علماء النفس الأمريكية (APA)
Xue, Mingfu& Yuan, Chengxiang& Wang, Jian& Liu, Weiqiang. 2020. DPAEG: A Dependency Parse-Based Adversarial Examples Generation Method for Intelligent Q&A Robots. Security and Communication Networks،Vol. 2020, no. 2020, pp.1-15.
https://search.emarefa.net/detail/BIM-1208462
نمط استشهاد الجمعية الأمريكية للغات الحديثة (MLA)
Xue, Mingfu…[et al.]. DPAEG: A Dependency Parse-Based Adversarial Examples Generation Method for Intelligent Q&A Robots. Security and Communication Networks No. 2020 (2020), pp.1-15.
https://search.emarefa.net/detail/BIM-1208462
نمط استشهاد الجمعية الطبية الأمريكية (AMA)
Xue, Mingfu& Yuan, Chengxiang& Wang, Jian& Liu, Weiqiang. DPAEG: A Dependency Parse-Based Adversarial Examples Generation Method for Intelligent Q&A Robots. Security and Communication Networks. 2020. Vol. 2020, no. 2020, pp.1-15.
https://search.emarefa.net/detail/BIM-1208462
نوع البيانات
مقالات
لغة النص
الإنجليزية
الملاحظات
Includes bibliographical references
رقم السجل
BIM-1208462
قاعدة معامل التأثير والاستشهادات المرجعية العربي "ارسيف Arcif"
أضخم قاعدة بيانات عربية للاستشهادات المرجعية للمجلات العلمية المحكمة الصادرة في العالم العربي
![](/images/ebook-kashef.png)
تقوم هذه الخدمة بالتحقق من التشابه أو الانتحال في الأبحاث والمقالات العلمية والأطروحات الجامعية والكتب والأبحاث باللغة العربية، وتحديد درجة التشابه أو أصالة الأعمال البحثية وحماية ملكيتها الفكرية. تعرف اكثر
![](/images/kashef-image.png)