期刊论文详细信息
Scientific Reports 卷:16
Deep transfer learning-based approaches with multimodal fusion to improve the prediction of knee osteoarthritis progression: data from the OAI and MOST cohorts
Article
Daniela Herrera1  Ahmad Almhdie-Imjabbar1  Nada Ibrahim2  Hechmi Toumi1,2,3  Eric Lespessailles1,2 
[1] Laboratoire des Adaptations Métaboliques à l’Exercice en Conditions Physiologiques et Pathologiques (AME2P), Université Clermont Auvergne (UCA), 3 Rue de la Chebarde, 63178, Aubière, France
[2] Department of Rheumatology, University Hospital Center of Orleans, Orléans, France
[3] Translational Medicine Research Platform, PRIMMO, University Hospital Center of Orleans, 14 Avenue de L’Hôpital, 45067, Orléans Cedex 2, France
关键词: Knee osteoarthritis;    Transfer learning;    Deep learning;    Multimodal modeling;    MRI;    X-ray imaging;    Disease progression prediction;   
DOI  :  10.1038/s41598-026-68440-7
 received in 2026-03-02, accepted in 2026-08-21,  发布年份 2026
来源: Springer
PDF
【 摘 要 】

Effective diagnosis and management of knee osteoarthritis (KOA) increasingly rely on integrating diverse data sources, including imaging and clinical information. This study aimed to evaluate the use of multimodal deep learning models assisted by transfer learning (TL) to enhance the prediction of KOA progression. Deep learning models (ResNet-34 and DenseNet-201) were employed for magnetic resonance imaging (MRI) and X-ray feature extraction. A set of single-modality, dual-modality, and multimodal configurations incorporating MRI, X-ray, and radio-clinical data were evaluated using intermediate fusion. A total of 1714 patients were selected from the Osteoarthritis Initiative (OAI) and Multicenter Osteoarthritis Study (MOST) cohorts. TL strategies included one-step transfer using ImageNet pretrained weights and two-step transfer initially pretraining on one KOA cohort (OAI or MOST) and then fine-tuning and validating on an external KOA cohort (MOST or OAI). Results demonstrated that ImageNet-based TL significantly improved the predictive performance of X-ray models, with AUC scores exceeding 0.7 in both the OAI and MOST cohorts. For MRI-based models, the lack of large-scale pretrained weights limited the performance benefit of TL. Multimodal configurations offered no clear advantage over unimodal or dual-modality models. Without TL, DenseNet outperformed ResNet. These findings underscore the potential of transfer learning in predicting radiographic KOA progression.

【 授权许可】

CC BY   
© The Author(s) 2026

【 预 览 】
附件列表
Files Size Format View
RO202609300002594ZK.pdf 1710KB PDF download
RO202609300000995ZK.pdf 1192KB PDF download
Fig. 2 1106KB Image download
RO202609300000009ZK.pdf 2474KB PDF download
Fig. 3 89KB Image download
【 图 表 】

Fig. 3

Fig. 2

【 参考文献 】
  • [1]
  • [2]
  • [3]
  • [4]
  • [5]
  • [6]
  • [7]
  • [8]
  • [9]
  • [10]
  • [11]
  • [12]
  • [13]
  • [14]
  • [15]
  • [16]
  • [17]
  • [18]
  • [19]
  • [20]
  • [21]
  • [22]
  • [23]
  • [24]
  • [25]
  • [26]
  • [27]
  • [28]
  • [29]
  • [30]
  • [31]
  • [32]
  • [33]
  • [34]
  • [35]
  • [36]
  • [37]
  • [38]
  • [39]
  • [40]
  • [41]
  • [42]
  • [43]
  • [44]
  • [45]
  • [46]
  • [47]
  文献评价指标  
  下载次数:0次 浏览次数:0次