Chinese medical entity recognition based on the dual-branch TENER model

BMC Medical Informatics and Decision Making

Research

Hui Peng¹  Dan Liu¹  Zhichang Zhang¹  Xiaohui Qin¹ 

[1] College of Computer Science and Engineering, Northwest Normal University, 967 Anning East Road, 730070, Lanzhou, China;

关键词: Electronic medical records;    Named entity recognition;    TENER;    Char-Entity-Transformer;    Dual-branch;   

DOI  :  10.1186/s12911-023-02243-y

 received in 2022-06-30, accepted in 2023-07-18,  发布年份 2023

来源: Springer

【 摘 要 】

BackgroundNamed Entity Recognition (NER) is a long-standing fundamental problem in various research fields of Natural Language Processing (NLP) and has been practiced in many application scenarios. However, the application results of NER methods in Chinese electronic medical records (EMRs) are not satisfactory, mainly due to the following two problems: (1) Existing methods do not take into account the impact of medical terminology on model recognition performance, resulting in poor model performance. (2) Existing methods do not fully utilize the Chinese language features contained in EMR, resulting in poor model robustness. Therefore, it is imminent to solve these two problems regarding the performance of the NER model for EMRs.MethodsIn this paper, a TENER-based radical feature and entity augmentation model for NER in Chinese EMRs is proposed. The TENER model is first used in the pre-training stage to extract deep semantic information from each layer of the feature extractor. In the decoder part, the recognition of medical entity boundary and entity category are divided into two branch tasks.ResultsWe compare the overall performance of the proposed model with existing models on different datasets using the computed F1 score evaluation metric. The experimental results show that our model achieves the best F1 score of 82.67%, 74.37%, 70.16% on the CCKS2019, ERTCMM, and CEMR data sets. Meanwhile, in the CMeEE challenge, our model surpassed the top-3 with the F1 score of 68.39%.ConclusionsOur proposed model is the first to divide the NER task into a two-branch tasks, entity boundary and types recognition. Firstly, the medical entity dictionary information is integrated into TENER to obtain the feature information of professional terms in Chinese EMRs. Secondly, the features of Chinese radicals in Chinese EMRs extracted by CNN are added to the entity category recognition task. Finally, the effectiveness of the model is validated on four datasets and competitive results are achieved.

【 授权许可】

CC BY   
© The Author(s) 2023

【 图 表 】

13690_2023_1147_Article_IEq4.gif

13690_2023_1147_Article_IEq3.gif

13690_2023_1147_Article_IEq1.gif

Fig. 3

Fig. 1.

Fig. 1

Fig. 6

Fig. 3

Fig. 2

Fig. 3

Fig. 7

Fig. 5

Fig. 2

Fig. 4

Fig. 5

Fig. 1

12862_2023_2133_Article_IEq80.gif

Fig. 6

Fig. 2

Fig. 1

Fig. 1

Fig. 2

Fig. 1

Fig. 1

Fig. 1

Fig. 1

Fig. 3

Fig. 1

12862_2023_2148_Article_IEq5.gif

Fig. 11

Fig. 4

Fig. 1

Fig. 1

Fig. 1

Fig. 1

12862_2023_2133_Article_IEq61.gif

Fig. 2

Fig. 4

Fig. 5

Fig. 3

Fig. 2

Fig. 1

Fig. 6

Fig. 1

Fig. 6

Fig. 1

Fig. 4

13690_2023_1163_Article_IEq2.gif

Fig. 1