Detecting Hypernymy Relations Between Medical Compound Entities Using a Hybrid-Attention Based Bi-GRU-CapsNet Model

IEEE Access

Yangming Zhou¹  Chenming Xu¹  Zhiyuan Ma²  Qi Wang²  Yan Zhu³ 

[1] Key Laboratory of Advanced Control and Optimization for Chemical Processes, Ministry of Education, East China University of Science and Technology, Shanghai, China;School of Information Science and Engineering, East China University of Science and Technology, Shanghai, China;School of Science, East China University of Science and Technology, Shanghai, China;

关键词: Capsule network;    medical compound entities;    electronic health records;    hybrid attention mechanism;    hypernymy detection;   

DOI  :  10.1109/ACCESS.2019.2957827

来源: DOAJ

【 摘 要 】

Named entities composed of multiple continuous words frequently occur in domain-specific knowledge graphs. In general, these named entities are composable and extensible, such as names of symptoms and diseases in the medical domain. Unlike the general entities, we address them as compound entities, and try to identify hypernymy relations between them. Hypernymy detection between compound entities plays a critical role in domain-specific knowledge graph construction. Traditional hypernymy detection approaches do not perform well on compound entities for two reasons. One is the lack of contextual information, and the other is the absence of compound entities, i.e. out-of-vocabulary (OOV) problem. In this paper, we propose a hybrid-attention-based method called Bi-GRU-CapsNet for the detection of hypernymy relations. The hybrid attention mechanism consists of heuristic attention and self-adaptive attention, which are used for the lack of contextual information. The attentions focus on the differences of two compound entities on the lexical and semantic level, respectively. For OOV problem, the English words or Chinese characters in compound entities are fed into bidirectional gated recurrent units (Bi-GRUs). Additionally, we use capsule network (CapsNet) to determine the existence of hypernymy relations under different cases. Experimental results show that our proposed method outperforms other baseline methods on both English and Chinese corpora of symptom and disease pairs.

【 授权许可】

Unknown