The emergency transcriber: a situation-aware recording system for noisy acoustic environments

Cyber-physical System;Sensing Classification;Speech Recognition;Situation Awareness;Emergency Personnel

Gao, Yunlong ; Abdelzaher ; Tarek F.

关键词: Cyber-physical System;    Sensing Classification;    Speech Recognition;    Situation Awareness;    Emergency Personnel;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/50632/Yunlong_Gao.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

The thesis presents a novel situation awareness tool for sensing classification. We proposed a general scheme for sensing, and applied that to build an acoustic tool for teams of first responders and emergency personnel. It constitutesan audio interface for reliably recording and disseminating situation progress as extracted from the team’s audio communications. The tool that we built is intended for emergency teams operating in noisy acoustic environments, where standalone speech recognition systems fail to deliver desired accuracy. Such teams typically follow predefined collaborative workflow as dictatedby the relevant engagement protocols, specifying their roles and communications. Given the critical nature of the situation, the vocabulary used is often constrained and dependent on the current stage of the workflow beingexecuted. Treating a traditional speech recognition component as a noisy sensor, the novelty of our tool lies in exploiting knowledge of the workflow to correct the noisy measurements. The intellectual contribution in this exploitation lies in the joint estimation of the current state of the workflow together with the correction of sensed data, given only the noisy (speech) measurements and an overall workflow description. Evaluation shows that the tool provides a significant accuracy enhancement compared to the standalone speech recognition, effectively coping with the noisy environment ofemergency teams.