Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis: an evaluation of four automated methods against manual reference segmentations in a multi-center cohort

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Standard

Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis : an evaluation of four automated methods against manual reference segmentations in a multi-center cohort. / de Sitter, Alexandra; Verhoeven, Tom; Burggraaff, Jessica; Liu, Yaou; Simoes, Jorge; Ruggieri, Serena; Palotai, Miklos; Brouwer, Iman; Versteeg, Adriaan; Wottschel, Viktor; Ropele, Stefan; Rocca, Mara A.; Gasperini, Claudio; Gallo, Antonio; Yiannakas, Marios C.; Rovira, Alex; Enzinger, Christian; Filippi, Massimo; De Stefano, Nicola; Kappos, Ludwig; Frederiksen, Jette L.; Uitdehaag, Bernard M.J.; Barkhof, Frederik; Guttmann, Charles R.G.; Vrenken, Hugo; the MAGNIMS Study Group.

I: Journal of Neurology, Bind 267, Nr. 12, 2020, s. 3541-3554.

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Harvard

de Sitter, A, Verhoeven, T, Burggraaff, J, Liu, Y, Simoes, J, Ruggieri, S, Palotai, M, Brouwer, I, Versteeg, A, Wottschel, V, Ropele, S, Rocca, MA, Gasperini, C, Gallo, A, Yiannakas, MC, Rovira, A, Enzinger, C, Filippi, M, De Stefano, N, Kappos, L, Frederiksen, JL, Uitdehaag, BMJ, Barkhof, F, Guttmann, CRG, Vrenken, H & the MAGNIMS Study Group 2020, 'Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis: an evaluation of four automated methods against manual reference segmentations in a multi-center cohort', Journal of Neurology, bind 267, nr. 12, s. 3541-3554. https://doi.org/10.1007/s00415-020-10023-1

APA

de Sitter, A., Verhoeven, T., Burggraaff, J., Liu, Y., Simoes, J., Ruggieri, S., Palotai, M., Brouwer, I., Versteeg, A., Wottschel, V., Ropele, S., Rocca, M. A., Gasperini, C., Gallo, A., Yiannakas, M. C., Rovira, A., Enzinger, C., Filippi, M., De Stefano, N., ... the MAGNIMS Study Group (2020). Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis: an evaluation of four automated methods against manual reference segmentations in a multi-center cohort. Journal of Neurology, 267(12), 3541-3554. https://doi.org/10.1007/s00415-020-10023-1

Vancouver

de Sitter A, Verhoeven T, Burggraaff J, Liu Y, Simoes J, Ruggieri S o.a. Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis: an evaluation of four automated methods against manual reference segmentations in a multi-center cohort. Journal of Neurology. 2020;267(12):3541-3554. https://doi.org/10.1007/s00415-020-10023-1

Author

de Sitter, Alexandra ; Verhoeven, Tom ; Burggraaff, Jessica ; Liu, Yaou ; Simoes, Jorge ; Ruggieri, Serena ; Palotai, Miklos ; Brouwer, Iman ; Versteeg, Adriaan ; Wottschel, Viktor ; Ropele, Stefan ; Rocca, Mara A. ; Gasperini, Claudio ; Gallo, Antonio ; Yiannakas, Marios C. ; Rovira, Alex ; Enzinger, Christian ; Filippi, Massimo ; De Stefano, Nicola ; Kappos, Ludwig ; Frederiksen, Jette L. ; Uitdehaag, Bernard M.J. ; Barkhof, Frederik ; Guttmann, Charles R.G. ; Vrenken, Hugo ; the MAGNIMS Study Group. / Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis : an evaluation of four automated methods against manual reference segmentations in a multi-center cohort. I: Journal of Neurology. 2020 ; Bind 267, Nr. 12. s. 3541-3554.

Bibtex

@article{cd5cedc4e7754743957626cb97561b34,
title = "Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis: an evaluation of four automated methods against manual reference segmentations in a multi-center cohort",
abstract = "Background: Deep grey matter (DGM) atrophy in multiple sclerosis (MS) and its relation to cognitive and clinical decline requires accurate measurements. MS pathology may deteriorate the performance of automated segmentation methods. Accuracy of DGM segmentation methods is compared between MS and controls, and the relation of performance with lesions and atrophy is studied. Methods: On images of 21 MS subjects and 11 controls, three raters manually outlined caudate nucleus, putamen and thalamus; outlines were combined by majority voting. FSL-FIRST, FreeSurfer, Geodesic Information Flow and volBrain were evaluated. Performance was evaluated volumetrically (intra-class correlation coefficient (ICC)) and spatially (Dice similarity coefficient (DSC)). Spearman's correlations of DSC with global and local lesion volume, structure of interest volume (ROIV), and normalized brain volume (NBV) were assessed. Results: ICC with manual volumes was mostly good and spatial agreement was high. MS exhibited significantly lower DSC than controls for thalamus and putamen. For some combinations of structure and method, DSC correlated negatively with lesion volume or positively with NBV or ROIV. Lesion-filling did not substantially change segmentations. Conclusions: Automated methods have impaired performance in patients. Performance generally deteriorated with higher lesion volume and lower NBV and ROIV, suggesting that these may contribute to the impaired performance.",
keywords = "Atrophy, Automated segmentation methods, Deep grey matter, Multiple sclerosis",
author = "{de Sitter}, Alexandra and Tom Verhoeven and Jessica Burggraaff and Yaou Liu and Jorge Simoes and Serena Ruggieri and Miklos Palotai and Iman Brouwer and Adriaan Versteeg and Viktor Wottschel and Stefan Ropele and Rocca, {Mara A.} and Claudio Gasperini and Antonio Gallo and Yiannakas, {Marios C.} and Alex Rovira and Christian Enzinger and Massimo Filippi and {De Stefano}, Nicola and Ludwig Kappos and Frederiksen, {Jette L.} and Uitdehaag, {Bernard M.J.} and Frederik Barkhof and Guttmann, {Charles R.G.} and Hugo Vrenken and {the MAGNIMS Study Group}",
year = "2020",
doi = "10.1007/s00415-020-10023-1",
language = "English",
volume = "267",
pages = "3541--3554",
journal = "Deutsche Zeitschrift fur Nervenheilkunde",
issn = "0939-1517",
publisher = "Springer Medizin",
number = "12",

}

RIS

TY - JOUR

T1 - Reduced accuracy of MRI deep grey matter segmentation in multiple sclerosis

T2 - an evaluation of four automated methods against manual reference segmentations in a multi-center cohort

AU - de Sitter, Alexandra

AU - Verhoeven, Tom

AU - Burggraaff, Jessica

AU - Liu, Yaou

AU - Simoes, Jorge

AU - Ruggieri, Serena

AU - Palotai, Miklos

AU - Brouwer, Iman

AU - Versteeg, Adriaan

AU - Wottschel, Viktor

AU - Ropele, Stefan

AU - Rocca, Mara A.

AU - Gasperini, Claudio

AU - Gallo, Antonio

AU - Yiannakas, Marios C.

AU - Rovira, Alex

AU - Enzinger, Christian

AU - Filippi, Massimo

AU - De Stefano, Nicola

AU - Kappos, Ludwig

AU - Frederiksen, Jette L.

AU - Uitdehaag, Bernard M.J.

AU - Barkhof, Frederik

AU - Guttmann, Charles R.G.

AU - Vrenken, Hugo

AU - the MAGNIMS Study Group

PY - 2020

Y1 - 2020

N2 - Background: Deep grey matter (DGM) atrophy in multiple sclerosis (MS) and its relation to cognitive and clinical decline requires accurate measurements. MS pathology may deteriorate the performance of automated segmentation methods. Accuracy of DGM segmentation methods is compared between MS and controls, and the relation of performance with lesions and atrophy is studied. Methods: On images of 21 MS subjects and 11 controls, three raters manually outlined caudate nucleus, putamen and thalamus; outlines were combined by majority voting. FSL-FIRST, FreeSurfer, Geodesic Information Flow and volBrain were evaluated. Performance was evaluated volumetrically (intra-class correlation coefficient (ICC)) and spatially (Dice similarity coefficient (DSC)). Spearman's correlations of DSC with global and local lesion volume, structure of interest volume (ROIV), and normalized brain volume (NBV) were assessed. Results: ICC with manual volumes was mostly good and spatial agreement was high. MS exhibited significantly lower DSC than controls for thalamus and putamen. For some combinations of structure and method, DSC correlated negatively with lesion volume or positively with NBV or ROIV. Lesion-filling did not substantially change segmentations. Conclusions: Automated methods have impaired performance in patients. Performance generally deteriorated with higher lesion volume and lower NBV and ROIV, suggesting that these may contribute to the impaired performance.

AB - Background: Deep grey matter (DGM) atrophy in multiple sclerosis (MS) and its relation to cognitive and clinical decline requires accurate measurements. MS pathology may deteriorate the performance of automated segmentation methods. Accuracy of DGM segmentation methods is compared between MS and controls, and the relation of performance with lesions and atrophy is studied. Methods: On images of 21 MS subjects and 11 controls, three raters manually outlined caudate nucleus, putamen and thalamus; outlines were combined by majority voting. FSL-FIRST, FreeSurfer, Geodesic Information Flow and volBrain were evaluated. Performance was evaluated volumetrically (intra-class correlation coefficient (ICC)) and spatially (Dice similarity coefficient (DSC)). Spearman's correlations of DSC with global and local lesion volume, structure of interest volume (ROIV), and normalized brain volume (NBV) were assessed. Results: ICC with manual volumes was mostly good and spatial agreement was high. MS exhibited significantly lower DSC than controls for thalamus and putamen. For some combinations of structure and method, DSC correlated negatively with lesion volume or positively with NBV or ROIV. Lesion-filling did not substantially change segmentations. Conclusions: Automated methods have impaired performance in patients. Performance generally deteriorated with higher lesion volume and lower NBV and ROIV, suggesting that these may contribute to the impaired performance.

KW - Atrophy

KW - Automated segmentation methods

KW - Deep grey matter

KW - Multiple sclerosis

UR - http://www.scopus.com/inward/record.url?scp=85087420490&partnerID=8YFLogxK

U2 - 10.1007/s00415-020-10023-1

DO - 10.1007/s00415-020-10023-1

M3 - Journal article

C2 - 32621103

AN - SCOPUS:85087420490

VL - 267

SP - 3541

EP - 3554

JO - Deutsche Zeitschrift fur Nervenheilkunde

JF - Deutsche Zeitschrift fur Nervenheilkunde

SN - 0939-1517

IS - 12

ER -

ID: 260358040