Recognizing clinical entities in hospital discharge summaries using Structural Support Vector Machines with word representation features

BMC Medical Informatics and Decision Making

Proceedings

Min Jiang¹  Yonghui Wu¹  Hua Xu¹  Buzhou Tang²  Hongxin Cao³ 

[1] School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA;School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, Texas, USA;Harbin Institute of Technology Shenzhen Graduate School, Shenzhen, China;Second Military Medical University Shanghai, China;

关键词: Natural Language Processing;    Conditional Random Field;    Unify Medical Language System;    Name Entity Recognition;    Entity Recognition;   

DOI  :  10.1186/1472-6947-13-S1-S1

来源: Springer

【 摘 要 】

BackgroundNamed entity recognition (NER) is an important task in clinical natural language processing (NLP) research. Machine learning (ML) based NER methods have shown good performance in recognizing entities in clinical text. Algorithms and features are two important factors that largely affect the performance of ML-based NER systems. Conditional Random Fields (CRFs), a sequential labelling algorithm, and Support Vector Machines (SVMs), which is based on large margin theory, are two typical machine learning algorithms that have been widely applied to clinical NER tasks. For features, syntactic and semantic information of context words has often been used in clinical NER systems. However, Structural Support Vector Machines (SSVMs), an algorithm that combines the advantages of both CRFs and SVMs, and word representation features, which contain word-level back-off information over large unlabelled corpus by unsupervised algorithms, have not been extensively investigated for clinical text processing. Therefore, the primary goal of this study is to evaluate the use of SSVMs and word representation features in clinical NER tasks.MethodsIn this study, we developed SSVMs-based NER systems to recognize clinical entities in hospital discharge summaries, using the data set from the concept extration task in the 2010 i2b2 NLP challenge. We compared the performance of CRFs and SSVMs-based NER classifiers with the same feature sets. Furthermore, we extracted two different types of word representation features (clustering-based representation features and distributional representation features) and integrated them with the SSVMs-based clinical NER system. We then reported the performance of SSVM-based NER systems with different types of word representation features.Results and discussionUsing the same training (N = 27,837) and test (N = 45,009) sets in the challenge, our evaluation showed that the SSVMs-based NER systems achieved better performance than the CRFs-based systems for clinical entity recognition, when same features were used. Both types of word representation features (clustering-based and distributional representations) improved the performance of ML-based NER systems. By combining two different types of word representation features together with SSVMs, our system achieved a highest F-measure of 85.82%, which outperformed the best system reported in the challenge by 0.6%. Our results show that SSVMs is a great potential algorithm for clinical NLP research, and both types of unsupervised word representation features are beneficial to clinical NER tasks.

【 授权许可】

Unknown   
© Tang et al.; licensee BioMed Central Ltd. 2013. This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.