| Scientific Reports | 卷:16 |
| Deep transfer learning-based approaches with multimodal fusion to improve the prediction of knee osteoarthritis progression: data from the OAI and MOST cohorts | |
| Article | |
| Daniela Herrera1  Ahmad Almhdie-Imjabbar1  Nada Ibrahim2  Hechmi Toumi1,2,3  Eric Lespessailles1,2  | |
| [1] Laboratoire des Adaptations Métaboliques à l’Exercice en Conditions Physiologiques et Pathologiques (AME2P), Université Clermont Auvergne (UCA), 3 Rue de la Chebarde, 63178, Aubière, France | |
| [2] Department of Rheumatology, University Hospital Center of Orleans, Orléans, France | |
| [3] Translational Medicine Research Platform, PRIMMO, University Hospital Center of Orleans, 14 Avenue de L’Hôpital, 45067, Orléans Cedex 2, France | |
| 关键词: Knee osteoarthritis; Transfer learning; Deep learning; Multimodal modeling; MRI; X-ray imaging; Disease progression prediction; | |
| DOI : 10.1038/s41598-026-68440-7 | |
| received in 2026-03-02, accepted in 2026-08-21, 发布年份 2026 | |
| 来源: Springer | |
PDF
|
|
【 摘 要 】
Effective diagnosis and management of knee osteoarthritis (KOA) increasingly rely on integrating diverse data sources, including imaging and clinical information. This study aimed to evaluate the use of multimodal deep learning models assisted by transfer learning (TL) to enhance the prediction of KOA progression. Deep learning models (ResNet-34 and DenseNet-201) were employed for magnetic resonance imaging (MRI) and X-ray feature extraction. A set of single-modality, dual-modality, and multimodal configurations incorporating MRI, X-ray, and radio-clinical data were evaluated using intermediate fusion. A total of 1714 patients were selected from the Osteoarthritis Initiative (OAI) and Multicenter Osteoarthritis Study (MOST) cohorts. TL strategies included one-step transfer using ImageNet pretrained weights and two-step transfer initially pretraining on one KOA cohort (OAI or MOST) and then fine-tuning and validating on an external KOA cohort (MOST or OAI). Results demonstrated that ImageNet-based TL significantly improved the predictive performance of X-ray models, with AUC scores exceeding 0.7 in both the OAI and MOST cohorts. For MRI-based models, the lack of large-scale pretrained weights limited the performance benefit of TL. Multimodal configurations offered no clear advantage over unimodal or dual-modality models. Without TL, DenseNet outperformed ResNet. These findings underscore the potential of transfer learning in predicting radiographic KOA progression.
【 授权许可】
CC BY
© The Author(s) 2026
【 预 览 】
| Files | Size | Format | View |
|---|---|---|---|
| RO202609300002594ZK.pdf | 1710KB | ||
| RO202609300000995ZK.pdf | 1192KB | ||
| Fig. 2 | 1106KB | Image | |
| RO202609300000009ZK.pdf | 2474KB | ||
| Fig. 3 | 89KB | Image |
【 图 表 】
Fig. 3
Fig. 2
【 参考文献 】
- [1]
- [2]
- [3]
- [4]
- [5]
- [6]
- [7]
- [8]
- [9]
- [10]
- [11]
- [12]
- [13]
- [14]
- [15]
- [16]
- [17]
- [18]
- [19]
- [20]
- [21]
- [22]
- [23]
- [24]
- [25]
- [26]
- [27]
- [28]
- [29]
- [30]
- [31]
- [32]
- [33]
- [34]
- [35]
- [36]
- [37]
- [38]
- [39]
- [40]
- [41]
- [42]
- [43]
- [44]
- [45]
- [46]
- [47]
PDF