Multi-site benchmark classification of major depressive disorder using machine learning on cortical and subcortical measures.
Journal: Scientific reports
Volume: 14
Issue: 1
Year of Publication: 2024
Affiliated Institutions:
Laboratory of Systems Neuroscience and Imaging in Psychiatry (SNIP-Lab), Department of Psychiatry and Psychotherapy, University Medical Center Göttingen (UMG), Georg-August University, Von-Siebold-Str. , , Göttingen, Germany.
Department of Psychiatry, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands.
Department of Biomedical Sciences of Cells and Systems, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.
Department of Psychiatry and Mental Health, University of Cape Town, Cape Town, South Africa.
Department of Psychiatry and Behavioral Science, University of Minnesota Medical School, Minneapolis, MN, USA.
Division of Neuroscience, IRCCS San Raffaele Scientific Institute, Milan, Italy.
Department of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany.
Institute for Radiology and Neuroradiology, University Medicine Greifswald, Greifswald, Germany.
Imaging Genetics Center, Mark and Mary Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA, USA.
Department of Biomedical Sciences, Florida State University, Tallahassee, FL, USA.
Melbourne Neuropsychiatry Centre, Department of Psychiatry, The University of Melbourne, Parkville, VIC, Australia.
Department of Psychology, School of Arts and Social Sciences, City, University of London, London, UK.
Experimental Therapeutics and Pathophysiology Branch, National Institute for Mental Health, National Institutes of Health, Bethesda, MD, USA.
School of Psychology, University of East London, London, UK.
SoCAT Lab, Department of Psychiatry, School of Medicine, Ege University, Izmir, Turkey.
Department of Psychology, Stanford University, Stanford, CA, USA.
Department of Psychiatry and Psychotherapy, University Medicine Greifswald, Greifswald, Germany.
Center for Social and Affective Neuroscience, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden.
Department of Psychiatry and Behavioral Sciences, Division of Child and Adolescent Psychiatry, Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA.
Louis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, Houston, TX, USA.
Department of Psychiatry, McGill University, Montreal, QC, Canada.
Department of Psychology, University of Minnesota, Minneapolis, MN, USA.
Cardiff University Brain Research Imaging Center, Cardiff University, Cardiff, UK.
Departments of Psychiatry and Pediatrics, University of Calgary, Calgary, AB, Canada.
Center for Neuroscience, University of Pittsburgh, Pittsburgh, PA, USA.
FIDMAG Germanes Hospitalàries Research Foundation, Centro de Investigación Biomédica en Red de Salud Mental (CIBERSAM), Barcelona, Catalonia, Spain.
Sant Pau Mental Health Research Group, Institut de Recerca de L'Hospital de La Santa Creu I Sant Pau, Barcelona, Catalonia, Spain.
Centre for Youth Mental Health, The University of Melbourne, Parkville, VIC, Australia.
Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Amsterdam, The Netherlands.
Meditation Research Program, Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
Max Planck Institute of Psychiatry, Munich, Germany.
West Region, Institute of Mental Health, Singapore, Singapore.
Center Of Excellence On Mood Disorders, Louis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences at McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, USA.
SA MRC Research Unit on Risk and Resilience in Mental Disorders, Department of Psychiatry and Neuroscience Institute, University of Cape Town, Cape Town, South Africa.
Leiden Institute for Brain and Cognition, Leiden University Medical Center, Leiden, The Netherlands.
Institute for Community Medicine, University Medicine Greifswald, Greifswald, Germany.
Melbourne Neuropsychiatry Centre, Department of Psychiatry, The University of Melbourne and Melbourne Health, Melbourne, VIC, Australia.
Queensland Brain Institute, The University of Queensland, Brisbane, QLD, Australia.
Section on the Neurobiology and Treatment of Mood Disorders, National Institute of Mental Health, Bethesda, MD, USA.
Laboratory of Systems Neuroscience and Imaging in Psychiatry (SNIP-Lab), Department of Psychiatry and Psychotherapy, University Medical Center Göttingen (UMG), Georg-August University, Von-Siebold-Str. , , Göttingen, Germany. roberto.goya@med.uni-goettingen.de.
Abstract summary
Machine learning (ML) techniques have gained popularity in the neuroimaging field due to their potential for classifying neuropsychiatric disorders. However, the diagnostic predictive power of the existing algorithms has been limited by small sample sizes, lack of representativeness, data leakage, and/or overfitting. Here, we overcome these limitations with the largest multi-site sample size to date (N = 5365) to provide a generalizable ML classification benchmark of major depressive disorder (MDD) using shallow linear and non-linear models. Leveraging brain measures from standardized ENIGMA analysis pipelines in FreeSurfer, we were able to classify MDD versus healthy controls (HC) with a balanced accuracy of around 62%. But after harmonizing the data, e.g., using ComBat, the balanced accuracy dropped to approximately 52%. Accuracy results close to random chance levels were also observed in stratified groups according to age of onset, antidepressant use, number of episodes and sex. Future studies incorporating higher dimensional brain imaging/phenotype features, and/or using more advanced machine and deep learning methods may yield more encouraging prospects.
Authors & Co-authors:
Belov Vladimir V
Erwin-Grabner Tracy T
Aghajani Moji M
Aleman Andre A
Amod Alyssa R AR
Basgoze Zeynep Z
Benedetti Francesco F
Besteher Bianca B
Bülow Robin R
Ching Christopher R K CRK
Connolly Colm G CG
Cullen Kathryn K
Davey Christopher G CG
Dima Danai D
Dols Annemiek A
Evans Jennifer W JW
Fu Cynthia H Y CHY
Gonul Ali Saffet AS
Gotlib Ian H IH
Grabe Hans J HJ
Groenewold Nynke N
Hamilton J Paul JP
Harrison Ben J BJ
Ho Tiffany C TC
Mwangi Benson B
Jaworska Natalia N
Jahanshad Neda N
Klimes-Dougan Bonnie B
Koopowitz Sheri-Michelle SM
Lancaster Thomas T
Li Meng M
Linden David E J DEJ
MacMaster Frank P FP
Mehler David M A DMA
Melloni Elisa E
Mueller Bryon A BA
Ojha Amar A
Oudega Mardien L ML
Penninx Brenda W J H BWJH
Poletti Sara S
Pomarol-Clotet Edith E
Portella Maria J MJ
Pozzi Elena E
Reneman Liesbeth L
Sacchet Matthew D MD
Sämann Philipp G PG
Schrantee Anouk A
Sim Kang K
Soares Jair C JC
Stein Dan J DJ
Thomopoulos Sophia I SI
Uyar-Demir Aslihan A
van der Wee Nic J A NJA
van der Werff Steven J A SJA
Völzke Henry H
Whittle Sarah S
Wittfeld Katharina K
Wright Margaret J MJ
Wu Mon-Ju MJ
Yang Tony T TT
Zarate Carlos C
Veltman Dick J DJ
Schmaal Lianne L
Thompson Paul M PM
Goya-Maldonado Roberto R
Study Outcome
Source Link: Visit source