Assessment of Artificial Intelligence Automatic Multiple Sclerosis Lesion Delineation Tool for Clinical Use

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Dokumenter

  • Fulltext

    Forlagets udgivne version, 1,63 MB, PDF-dokument

  • Amalie Monberg Hindsholm
  • Stig Præstekjær Cramer
  • Helle Juhl Simonsen
  • Jette Lautrup Frederiksen
  • Flemming Andersen
  • Højgaard, Liselotte
  • Claes Nøhr Ladefoged
  • Ulrich Lindberg

Purpose: To implement and validate an existing algorithm for automatic delineation of white matter lesions on magnetic resonance imaging (MRI) in patients with multiple sclerosis (MS) on a local single-center dataset. Methods: We implemented a white matter hyperintensity segmentation model, based on a 2D convolutional neural network, using the conventional T2-weighted fluid attenuated inversion recovery (FLAIR) MRI sequence as input. The model was adapted for delineation of MS lesions by further training on a local dataset of 93 MS patients with a total of 3040 lesions. A quantitative evaluation was performed on ten test patients, in which model-generated masks were compared to manually delineated masks from two expert delineators. A subsequent qualitative evaluation of the implemented model was performed by two expert delineators, in which generated delineation masks on a clinical dataset of 53 patients were rated acceptable (< 10% errors) or unacceptable (> 10% errors) based on the total number of true lesions. Results: The quantitative evaluation resulted in an average accuracy score (F1) of 0.71, recall of 0.77 and dice similarity coefficient of 0.62. Our implemented model obtained the highest scores in all three metrics, when compared to three out of the box lesion segmentation models. In the clinical evaluation an average of 94% of our 53 model-generated masks were rated acceptable. Conclusion: After adaptation to our local dataset, the implemented segmentation model was able to delineate MS lesions with a high clinical value as rated by delineation experts while outperforming popular out of the box applications. This serves as a promising step towards implementation of automatic lesion delineation in our MS clinic.

OriginalsprogEngelsk
TidsskriftClinical Neuroradiology
Vol/bind32
Sider (fra-til)643–653
ISSN1869-1439
DOI
StatusUdgivet - 2022

Bibliografisk note

Funding Information:
We thank the John and Birthe Meyer Foundation for funding of this research.

Publisher Copyright:
© 2021, The Author(s).

ID: 304145856