ChatGPT is not ready yet for use in providing mental health assessment and interventions.

Journal: Frontiers in psychiatry

Volume: 14

Issue: 

Year of Publication: 

Affiliated Institutions:  Primary Health Care Corporation (PHCC), Doha, Qatar. The Tunisian Center of Early Intervention in Psychosis, Department of Psychiatry "Ibn Omrane", Razi Hospital, Manouba, Tunisia. School of Medicine and Medical Sciences, Holy Spirit University of Kaslik, Jounieh, Lebanon. Laboratorio de Neurociencias (LIM ), Hospital das Clínicas HCFMUSP, Faculdade de Medicina, Instituto de Psiquiatria, Universidade de Sao Paulo, São Paulo, Brazil. Neurotrack Technologies, Redwood City, CA, United States. High Institute of Sport and Physical Education, University of Sfax, Sfax, Tunisia. Department of Human and Social Sciences, Higher Institute of Sport and Physical Education of Kef, University of Jendouba, Jendouba, Tunisia. Research Unit Physical Activity, Sport, and Health, URJS, National Observatory of Sport, Tunis, Tunisia. Department of Health Sciences (DISSAL), Postgraduate School of Public Health, University of Genoa, Genoa, Italy. Faculty of Medicine, Aleppo University, Aleppo, Syria. Surgical Research Section, Department of Surgery, Hamad Medical Corporation, Doha, Qatar. Laboratory for Industrial and Applied Mathematics, Department of Mathematics and Statistics, York University, Toronto, ON, Canada. Service of Physiology and Functional Explorations, Farhat HACHED Hospital, University of Sousse, Sousse, Tunisia.

Abstract summary 

Psychiatry is a specialized field of medicine that focuses on the diagnosis, treatment, and prevention of mental health disorders. With advancements in technology and the rise of artificial intelligence (AI), there has been a growing interest in exploring the potential of AI language models systems, such as Chat Generative Pre-training Transformer (ChatGPT), to assist in the field of psychiatry.Our study aimed to evaluates the effectiveness, reliability and safeness of ChatGPT in assisting patients with mental health problems, and to assess its potential as a collaborative tool for mental health professionals through a simulated interaction with three distinct imaginary patients.Three imaginary patient scenarios (cases A, B, and C) were created, representing different mental health problems. All three patients present with, and seek to eliminate, the same chief complaint (i.e., difficulty falling asleep and waking up frequently during the night in the last 2°weeks). ChatGPT was engaged as a virtual psychiatric assistant to provide responses and treatment recommendations.In case A, the recommendations were relatively appropriate (albeit non-specific), and could potentially be beneficial for both users and clinicians. However, as complexity of clinical cases increased (cases B and C), the information and recommendations generated by ChatGPT became inappropriate, even dangerous; and the limitations of the program became more glaring. The main strengths of ChatGPT lie in its ability to provide quick responses to user queries and to simulate empathy. One notable limitation is ChatGPT inability to interact with users to collect further information relevant to the diagnosis and management of a patient's clinical condition. Another serious limitation is ChatGPT inability to use critical thinking and clinical judgment to drive patient's management.As for July 2023, ChatGPT failed to give the simple medical advice given certain clinical scenarios. This supports that the quality of ChatGPT-generated content is still far from being a guide for users and professionals to provide accurate mental health information. It remains, therefore, premature to conclude on the usefulness and safety of ChatGPT in mental health practice.

Authors & Co-authors:  Dergaa Ismail I Fekih-Romdhane Feten F Hallit Souheil S Loch Alexandre Andrade AA Glenn Jordan M JM Fessi Mohamed Saifeddin MS Ben Aissa Mohamed M Souissi Nizar N Guelmami Noomen N Swed Sarya S El Omri Abdelfatteh A Bragazzi Nicola Luigi NL Ben Saad Helmi H

Study Outcome 

Source Link: Visit source

Statistics
Citations :  GBD 2019 Mental Disorders Collaborators. Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet Psychiatry. (2022) 9:137–50. 10.1016/S2215-0366(21)00395-3
Authors :  13
Identifiers
Doi : 1277756
SSN : 1664-0640
Study Population
Male,Female
Mesh Terms
Other Terms
anxiety;chatbots;depression;insomnia;language models;mental health;patient care;psychiatric disorders
Study Design
Case Study,Cross Sectional Study
Study Approach
Country of Study
Publication Country
Switzerland