Combined Self-Attention Mechanism for Chinese Named Entity Recognition in Military

Future Internet

Liangli Ma¹  Fei Liao¹  Jingjing Pei²  Linshan Tan² 

[1] College of Electronic Engineering, Naval University of Engineering, Wuhan 430033, China;Force 91001, Beijing 100841, China;

关键词: military named entity recognition;    self-attention mechanism;    BiLSTM;   

DOI  :  10.3390/fi11080180

来源: DOAJ

【 摘 要 】

Military named entity recognition (MNER) is one of the key technologies in military information extraction. Traditional methods for the MNER task rely on cumbersome feature engineering and specialized domain knowledge. In order to solve this problem, we propose a method employing a bidirectional long short-term memory (BiLSTM) neural network with a self-attention mechanism to identify the military entities automatically. We obtain distributed vector representations of the military corpus by unsupervised learning and the BiLSTM model combined with the self-attention mechanism is adopted to capture contextual information fully carried by the character vector sequence. The experimental results show that the self-attention mechanism can improve effectively the performance of MNER task. The F-score of the military documents and network military texts identification was 90.15% and 89.34%, respectively, which was better than other models.

【 授权许可】

Unknown