Multidimensional Self-Attention for Aspect Term Extraction and Biomedical Named Entity Recognition

Joint Authors

Song, Xinyu
Feng, Ao
Wang, Weikuan
Gao, Zhengjie

Source

Mathematical Problems in Engineering

Issue

Vol. 2020, Issue 2020 (31 Dec. 2020), pp.1-6, 6 p.

Publisher

Hindawi Publishing Corporation

Publication Date

2020-12-14

Country of Publication

Egypt

No. of Pages

6

Main Subjects

Civil Engineering

Abstract EN

Wide attention has been paid to named entity recognition (NER) in specific fields.

Among the representative tasks are the aspect term extraction (ATE) in user online comments and the biomedical named entity recognition (BioNER) in medical documents.

Existing methods only perform well in a particular field, and it is difficult to maintain an advantage in other fields.

In this article, we propose a supervised learning method that can be used for much special domain NER tasks.

The model consists of two parts, a multidimensional self-attention (MDSA) network and a CNN-based model.

The multidimensional self-attention mechanism can calculate the importance of the context to the current word, select the relevance according to the importance, and complete the update of the word vector.

This update mechanism allows the subsequent CNN model to have variable-length memory of sentence context.

We conduct experiments on benchmark datasets of ATE and BioNER tasks.

The results show that our model surpasses most baseline methods.

American Psychological Association (APA)

Song, Xinyu& Feng, Ao& Wang, Weikuan& Gao, Zhengjie. 2020. Multidimensional Self-Attention for Aspect Term Extraction and Biomedical Named Entity Recognition. Mathematical Problems in Engineering،Vol. 2020, no. 2020, pp.1-6.
https://search.emarefa.net/detail/BIM-1201474

Modern Language Association (MLA)

Song, Xinyu…[et al.]. Multidimensional Self-Attention for Aspect Term Extraction and Biomedical Named Entity Recognition. Mathematical Problems in Engineering No. 2020 (2020), pp.1-6.
https://search.emarefa.net/detail/BIM-1201474

American Medical Association (AMA)

Song, Xinyu& Feng, Ao& Wang, Weikuan& Gao, Zhengjie. Multidimensional Self-Attention for Aspect Term Extraction and Biomedical Named Entity Recognition. Mathematical Problems in Engineering. 2020. Vol. 2020, no. 2020, pp.1-6.
https://search.emarefa.net/detail/BIM-1201474

Data Type

Journal Articles

Language

English

Notes

Includes bibliographical references

Record ID

BIM-1201474