Multilingual Conversational Systems to Drive the Collection of Patient-Reported Outcomes and Integration into Clinical Workflows

Symmetry

Rafael Pérez Luna¹  Gazihan Alankuş²  Umut Ariöz³  Valentino Šafran³  Izidor Mlakar³  Daniel Hari³  Matej Rojc³ 

[1] Dedalus Company, 28212 Madrid, Spain;Emoda Software, 35430 İzmir, Turkey;Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia;

关键词: patient reported outcomes;    multimodal sensing;    embodied conversational agents;    artificial intelligence;    spoken language interfaces;    cancer survivors;   

DOI  :  10.3390/sym13071187

来源: DOAJ

【 摘 要 】

Patient-reported outcomes (PROs) and their use in the clinical workflow can improve cancer survivors’ outcomes and quality of life. However, there are several challenges regarding efficient collection of the patient-reported outcomes and their integration into the clinical workflow. Patient adherence and interoperability are recognized as main barriers. This work implements a cancer-related study which interconnects artificial intelligence (spoken language algorithms, conversational intelligence) and natural sciences (embodied conversational agents) to create an omni-comprehensive system enabling symmetric computer-mediated interaction. Its goal is to collect patient information and integrate it into clinical routine as digital patient resources (the Fast Healthcare Interoperability Resources). To further increase convenience and simplicity of the data collection, a multimodal sensing network is delivered. In this paper, we introduce the main components of the system, including the mHealth application, the Open Health Connect platform, and algorithms to deliver speech enabled 3D embodied conversational agent to interact with the cancer survivors in five different languages. The system integrates cancer patients’ reported information as patient gathered health data into their digital clinical record. The value and impact of the integration will be further evaluated in the clinical study.

【 授权许可】

Unknown