Dimensionality reduction-based fusion approaches for imaging and non-imaging biomedical data: concepts, workflow, and use-cases

BMC Medical Imaging

Research Article

Satish E. Viswanath¹  George Lee¹  Pallavi Tiwari¹  Anant Madabhushi¹ 

[1] Department of Biomedical Engineering, Case Western Reserve University, 10900 Euclid Ave, Wickenden 523, Cleveland, OH, USA;

关键词: Data fusion;    Imaging;    Non-imaging;    Kernels;    Dimensionality reduction;   

DOI  :  10.1186/s12880-016-0172-6

 received in 2016-06-21, accepted in 2016-12-09,  发布年份 2017

来源: Springer

【 摘 要 】

BackgroundWith a wide array of multi-modal, multi-protocol, and multi-scale biomedical data being routinely acquired for disease characterization, there is a pressing need for quantitative tools to combine these varied channels of information. The goal of these integrated predictors is to combine these varied sources of information, while improving on the predictive ability of any individual modality. A number of application-specific data fusion methods have been previously proposed in the literature which have attempted to reconcile the differences in dimensionalities and length scales across different modalities. Our objective in this paper was to help identify metholodological choices that need to be made in order to build a data fusion technique, as it is not always clear which strategy is optimal for a particular problem. As a comprehensive review of all possible data fusion methods was outside the scope of this paper, we have focused on fusion approaches that employ dimensionality reduction (DR).MethodsIn this work, we quantitatively evaluate 4 non-overlapping existing instantiations of DR-based data fusion, within 3 different biomedical applications comprising over 100 studies. These instantiations utilized different knowledge representation and knowledge fusion methods, allowing us to examine the interplay of these modules in the context of data fusion. The use cases considered in this work involve the integration of (a) radiomics features from T2w MRI with peak area features from MR spectroscopy for identification of prostate cancer in vivo, (b) histomorphometric features (quantitative features extracted from histopathology) with protein mass spectrometry features for predicting 5 year biochemical recurrence in prostate cancer patients, and (c) volumetric measurements on T1w MRI with protein expression features to discriminate between patients with and without Alzheimers’ Disease.Results and conclusionsOur preliminary results in these specific use cases indicated that the use of kernel representations in conjunction with DR-based fusion may be most effective, as a weighted multi-kernel-based DR approach resulted in the highest area under the ROC curve of over 0.8. By contrast non-optimized DR-based representation and fusion methods yielded the worst predictive performance across all 3 applications. Our results suggest that when the individual modalities demonstrate relatively poor discriminability, many of the data fusion methods may not yield accurate, discriminatory representations either. In summary, to outperform the predictive ability of individual modalities, methodological choices for data fusion must explicitly account for the sparsity of and noise in the feature space.

【 授权许可】

CC BY   
© The Author(s) 2017

【 图 表 】

12864_2016_3440_Article_IEq71.gif

12864_2017_3920_Article_IEq7.gif

12864_2015_2129_Article_IEq33.gif

12864_2015_2129_Article_IEq31.gif

12864_2017_3920_Article_IEq5.gif

12864_2016_3194_Article_IEq3.gif

12864_2016_2580_Article_IEq3.gif

12864_2017_4359_Article_IEq1.gif

12864_2016_2793_Article_IEq40.gif

12864_2017_3605_Article_IEq3.gif

12864_2017_3492_Article_IEq1.gif

12864_2017_3605_Article_IEq2.gif

12864_2015_2192_Article_IEq29.gif

12864_2015_2192_Article_IEq27.gif

12864_2017_3733_Article_IEq31.gif

12864_2017_3990_Article_IEq8.gif

12864_2017_3990_Article_IEq7.gif

12864_2015_2192_Article_IEq23.gif

12864_2015_2192_Article_IEq22.gif

12864_2015_2192_Article_IEq21.gif

12864_2017_3610_Article_IEq1.gif