期刊论文详细信息
EURASIP Journal on Audio, Speech, and Music Processing
DOANet: a deep dilated convolutional neural network approach for search and rescue with drone-embedded sound source localization
Md. Farhan Shadiq1  Alif Bin Abdul Qayyum1  Adrita Anika1  Sheikh Asif Imran1  Md Mushfiqur Rahman1  Md. Tariqul Islam1  Mohammad Ariful Haque1  Shahruk Hossain1  K. M. Naimul Hassan1 
[1]Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, BUET Central Road, 1000, Dhaka, Bangladesh
关键词: DOA estimation;    DNN;    Sound source localization;    UAV;    DREGON;    Dilated CNN;   
DOI  :  10.1186/s13636-020-00184-2
来源: Springer
PDF
【 摘 要 】
Drone-embedded sound source localization (SSL) has interesting application perspective in challenging search and rescue scenarios due to bad lighting conditions or occlusions. However, the problem gets complicated by severe drone ego-noise that may result in negative signal-to-noise ratios in the recorded microphone signals. In this paper, we present our work on drone-embedded SSL using recordings from an 8-channel cube-shaped microphone array embedded in an unmanned aerial vehicle (UAV). We use angular spectrum-based TDOA (time difference of arrival) estimation methods such as generalized cross-correlation phase-transform (GCC-PHAT), minimum-variance-distortion-less-response (MVDR) as baseline, which are state-of-the-art techniques for SSL. Though we improve the baseline method by reducing ego-noise using speed correlated harmonics cancellation (SCHC) technique, our main focus is to utilize deep learning techniques to solve this challenging problem. Here, we propose an end-to-end deep learning model, called DOANet, for SSL. DOANet is based on a one-dimensional dilated convolutional neural network that computes the azimuth and elevation angles of the target sound source from the raw audio signal. The advantage of using DOANet is that it does not require any hand-crafted audio features or ego-noise reduction for DOA estimation. We then evaluate the SSL performance using the proposed and baseline methods and find that the DOANet shows promising results compared to both the angular spectrum methods with and without SCHC. To evaluate the different methods, we also introduce a well-known parameter—area under the curve (AUC) of cumulative histogram plots of angular deviations—as a performance indicator which, to our knowledge, has not been used as a performance indicator for this sort of problem before.
【 授权许可】

CC BY   

【 预 览 】
附件列表
Files Size Format View
RO202104286841161ZK.pdf 2280KB PDF download
  文献评价指标  
  下载次数:3次 浏览次数:5次