An online intelligent electronic medical record system via speech recognition

International Journal of Distributed Sensor Networks

Research Article

Yunlong Ma¹  Ye Luo²  Jianwei Lu³  Xin Xia⁴ 

[1] College of Electronic and Information Engineering, Tongji University, Shanghai, China;School of Software, Tongji University, Shanghai, China;School of Software, Tongji University, Shanghai, China;College of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, Shanghai, China;Engineering Research Center of Traditional Chinese Medicine Intelligent Rehabilitation, Ministry of Education, Shanghai, China;School of Software, Tongji University, Shanghai, China;East Hospital, School of Medicine, Tongji University, Shanghai, China;

关键词: Electronic medical record system;    speech recognition;    linguistic knowledge base;    semantic analysis;    electronic medical record;   

DOI  :  10.1177/15501329221134479

 received in 2022-01-17, accepted in 2022-06-28,  发布年份 2022

来源: Sage Journals

【 摘 要 】

Traditional electronic medical record systems in hospitals rely on healthcare workers to manually enter patient information, resulting in healthcare workers having to spend a significant amount of time each day filling out electronic medical records. This inefficient interaction seriously affects the communication between doctors and patients and reduces the speed at which doctors can diagnose patients’ conditions. The rapid development of deep learning–based speech recognition technology promises to improve this situation. In this work, we build an online electronic medical record system based on speech interaction. The system integrates a medical linguistic knowledge base, a specialized language model, a personalized acoustic model, and a fault-tolerance mechanism. Hence, we propose and develop an advanced electronic medical record system approach with multi-accent adaptive technology for avoiding the mistakes caused by accents, and it improves the accuracy of speech recognition obviously. For testing the proposed speech recognition electronic medical record system, we construct medical speech recognition data sets using audio and electronic medical records from real medical environments. On the data sets from real clinical scenarios, our proposed algorithm significantly outperforms other machine learning algorithms. Furthermore, compared to traditional electronic medical record systems that rely on keyboard inputs, our system is much more efficient, and its accuracy rate increases with the increasing online time of the proposed system. Our results show that the proposed electronic medical record system is expected to revolutionize the traditional working approach of clinical departments, and it serves more efficient in clinics with low time consumption compared with traditional electronic medical record systems depending on keyboard inputs, which has less recording mistakes and lows down the time consumption in modification of medical recordings; due to the proposed speech recognition electronic medical record system is built on knowledge database of medical terms, so it has a good generalized application and adaption in the clinical scenarios for hospitals.

【 授权许可】

CC BY   
© The Author(s) 2022

【 图 表 】

Figure 6

Figure 4

Figure 2

Figure 1

Figure 3

Figure 2

Figure 11.

Figure 2.