A CNN-based approach to identification of degradations in speech signals

EURASIP Journal on Audio, Speech, and Music Processing

Mads Græsbøll Christensen¹  Yuki Saishu¹  Amir Hossein Poorjam² 

[1] Audio Analysis Lab, CREATE, Aalborg University, Rendsburggade 14, 9000, Aalborg, Denmark;Audio Analysis Lab, CREATE, Aalborg University, Rendsburggade 14, 9000, Aalborg, Denmark;Verisk Analytics, 388 Market Street, 94111, San Francisco, CA, USA;

关键词: Signal enhancement;    Convolutional neural network;    Identification of degradation;    Quality control;    Visualization;   

DOI  :  10.1186/s13636-021-00198-4

来源: Springer

【 摘 要 】

The presence of degradations in speech signals, which causes acoustic mismatch between training and operating conditions, deteriorates the performance of many speech-based systems. A variety of enhancement techniques have been developed to compensate the acoustic mismatch in speech-based applications. To apply these signal enhancement techniques, however, it is necessary to know prior information about the presence and the type of degradations in speech signals. In this paper, we propose a new convolutional neural network (CNN)-based approach to automatically identify the major types of degradations commonly encountered in speech-based applications, namely additive noise, nonlinear distortion, and reverberation. In this approach, a set of parallel CNNs, each detecting a certain degradation type, is applied to the log-mel spectrogram of audio signals. Experimental results using two different speech types, namely pathological voice and normal running speech, show the effectiveness of the proposed method in detecting the presence and the type of degradations in speech signals which outperforms the state-of-the-art method. Using the score weighted class activation mapping, we provide a visual analysis of how the network makes decision for identifying different types of degradation in speech signals by highlighting the regions of the log-mel spectrogram which are more influential to the target degradation.

【 授权许可】

CC BY