Purpose: Artificial intelligence is increasingly showing potential in assisting physicians with disease diagnosis due to its improved predicting performance. In addition to achieving high performance, these systems must also be efficient and explainable. In this study, we propose a novel Feature Distillation method to transfer knowledge and explainability between models. Method: We employed our approach to transfer both knowledge and explainability from a complex VGG19 model (teacher) to a more computationally efficient MobileNet model (student). We show how our approach effectively addresses computational challenges in identifying four pulmonary statuses in chest X-ray images. We evaluated the performance and explainability achieved with varying amounts of training data. Results: Our results indicate that the feature-based distillation method enhances classification performance and model explainability compared to traditional knowledge distillation techniques and other direct, more computationally intensive explainability approaches. Specifically, our approach achieves up to +4% improvement in both F1-Score and explainability compared to other Explainability Distillation methods when using limited training data, demonstrating its effectiveness in balancing performance and interpretability. Conclusion: Such improvement makes our approach particularly suitable for resource-limited environments and practical applications in medical imaging.

Feature-based knowledge distillation for explainable detection of pulmonary diseases

Bacco L.;Matarrese M. A. G.;Merone M.;Pecchia L.
2025-01-01

Abstract

Purpose: Artificial intelligence is increasingly showing potential in assisting physicians with disease diagnosis due to its improved predicting performance. In addition to achieving high performance, these systems must also be efficient and explainable. In this study, we propose a novel Feature Distillation method to transfer knowledge and explainability between models. Method: We employed our approach to transfer both knowledge and explainability from a complex VGG19 model (teacher) to a more computationally efficient MobileNet model (student). We show how our approach effectively addresses computational challenges in identifying four pulmonary statuses in chest X-ray images. We evaluated the performance and explainability achieved with varying amounts of training data. Results: Our results indicate that the feature-based distillation method enhances classification performance and model explainability compared to traditional knowledge distillation techniques and other direct, more computationally intensive explainability approaches. Specifically, our approach achieves up to +4% improvement in both F1-Score and explainability compared to other Explainability Distillation methods when using limited training data, demonstrating its effectiveness in balancing performance and interpretability. Conclusion: Such improvement makes our approach particularly suitable for resource-limited environments and practical applications in medical imaging.
2025
Chest x-ray (CXR); Explainable AI (XAI); Feature distillation; Knowledge distillation; Medical imaging
File in questo prodotto:
File Dimensione Formato  
Health Technol.pdf

solo utenti autorizzati

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 737.74 kB
Formato Adobe PDF
737.74 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.12610/87565
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact