Audio classification and event detection based on small-size weakly labeled data

Weakly-labeled data;Audio event detection;Machine learning;Small-size sataset

Cheng, Chieh-Feng ; Anderson, David Davenport, Mark Electrical and Computer Engineering Moore, Elliot AlRegib, Ghassan Rashidi, Abbas Dyer, Eva ; Anderson, David

University:Georgia Institute of Technology

Department:Electrical and Computer Engineering

关键词: Weakly-labeled data;    Audio event detection;    Machine learning;    Small-size sataset;   

Others  :  https://smartech.gatech.edu/bitstream/1853/62715/1/CHENG-DISSERTATION-2020.pdf

美国|英语

来源: SMARTech Repository

【 摘 要 】

The objective of this research is to perform audio event detection and classification using small-size weakly labeled data. Although audio event detection has been studied for years, the research on this topic using weakly labeled data is limited. Many sources of multimedia data lack detailed annotation and rather have only high-level meta-data describing the main content of various long segments of the data. In this research, we illustrate a novel framework to perform audio classification when working with such weakly labeled data, especially when dealing with small-size datasets. Traditional approaches to this problem is to use techniques for strongly labeled data and then to deal with the weak nature of the labels via post-processing. In contrast, our approach directly addresses the weakly labeled aspect of the data by classifying longer windows of data based on the clustering behavior of the acoustic features over time. We evaluate our framework using both synthetic datasets and real data and demonstrate that our method works well under both situations. Also, it outperforms other existing methods when using small size datasets.