Unsupervised adaptation of PLDA models for broadcast diarization

EURASIP Journal on Audio, Speech, and Music Processing

Eduardo Lleida¹  Antonio Miguel¹  Ignacio Viñals¹  Alfonso Ortega¹  Jesús Villalba² 

[1] Aragón Institute for Engineering Research (I3A), University of Zaragoza;Center for Language and Speech Processing, Johns Hopkins University;

关键词: Diarization;    Unsupervised adaptation;    MGB;   

DOI  :  10.1186/s13636-019-0167-7

来源: DOAJ

【 摘 要 】

Abstract We present a novel model adaptation approach to deal with data variability for speaker diarization in a broadcast environment. Expensive human annotated data can be used to mitigate the domain mismatch by means of supervised model adaptation approaches. By contrast, we propose an unsupervised adaptation method which does not need for in-domain labeled data but only the recording that we are diarizing. We rely on an inner adaptation block which combines Agglomerative Hierarchical Clustering (AHC) and Mean-Shift (MS) clustering techniques with a Fully Bayesian Probabilistic Linear Discriminant Analysis (PLDA) to produce pseudo-speaker labels suitable for model adaptation. We propose multiple adaptation approaches based on this basic block, including unsupervised and semi-supervised. Our proposed solutions, analyzed with the Multi-Genre Broadcast 2015 (MGB) dataset, reported significant improvements (16% relative improvement) with respect to the baseline, also outperforming a supervised adaptation proposal with low resources (9% relative improvement). Furthermore, our proposed unsupervised adaptation is totally compatible with a supervised one. The joint use of both adaptation techniques (supervised and unsupervised) shows a 13% relative improvement with respect to only considering the supervised adaptation.

【 授权许可】

Unknown