iBet uBet web content aggregator. Adding the entire web to your favor.
iBet uBet web content aggregator. Adding the entire web to your favor.



Link to original content: http://pubmed.ncbi.nlm.nih.gov/39423001/
Describing the Framework for AI Tool Assessment in Mental Health and Applying It to a Generative AI Obsessive-Compulsive Disorder Platform: Tutorial - PubMed Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2024 Oct 18:8:e62963.
doi: 10.2196/62963.

Describing the Framework for AI Tool Assessment in Mental Health and Applying It to a Generative AI Obsessive-Compulsive Disorder Platform: Tutorial

Ashleigh Golden  1 , Elias Aboujaoude  1   2
Affiliations
Review

Describing the Framework for AI Tool Assessment in Mental Health and Applying It to a Generative AI Obsessive-Compulsive Disorder Platform: Tutorial

Ashleigh Golden et al. JMIR Form Res. .

Abstract

As artificial intelligence (AI) technologies occupy a bigger role in psychiatric and psychological care and become the object of increased research attention, industry investment, and public scrutiny, tools for evaluating their clinical, ethical, and user-centricity standards have become essential. In this paper, we first review the history of rating systems used to evaluate AI mental health interventions. We then describe the recently introduced Framework for AI Tool Assessment in Mental Health (FAITA-Mental Health), whose scoring system allows users to grade AI mental health platforms on key domains, including credibility, user experience, crisis management, user agency, health equity, and transparency. Finally, we demonstrate the use of FAITA-Mental Health scale by systematically applying it to OCD Coach, a generative AI tool readily available on the ChatGPT store and designed to help manage the symptoms of obsessive-compulsive disorder. The results offer insights into the utility and limitations of FAITA-Mental Health when applied to "real-world" generative AI platforms in the mental health space, suggesting that the framework effectively identifies key strengths and gaps in AI-driven mental health tools, particularly in areas such as credibility, user experience, and acute crisis management. The results also highlight the need for stringent standards to guide AI integration into mental health care in a manner that is not only effective but also safe and protective of the users' rights and welfare.

Keywords: ChatGPT; artificial intelligence; chatbots; digital health; generative AI; generative artificial intelligence; large language model; machine learning; obsessive-compulsive disorder; psychotherapy; telemedicine.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: None declared.

Similar articles

See all similar articles

References

    1. Guo Z, Lai A, Thygesen JH, Farrington J, Keen T, Li K. Large language model for mental health: a systematic review. arXiv. doi: 10.2196/preprints.57400. Preprint posted online February 19, 2024. https://arxiv.org/abs/2403.15401 - DOI - PubMed
    1. Hua Y, Liu F, Yang K, Li Z, Sheu YH, Zhou P, Moran L, Ananiadou S, Beam A. Large language models in mental health care: a scoping review. arXiv. doi: 10.2196/preprints.64088. Preprint posted online January 1, 2024. https://arxiv.org/abs/2401.02984 - DOI
    1. Lai T, Shi Y, Du Z, Wu J, Fu K, Dou Y, Wang Z. Supporting the demand on mental health services with AI-based conversational large language models (LLMs) BioMedInformatics. 2023 Dec 22;4(1):8–33. doi: 10.3390/biomedinformatics4010002. - DOI
    1. Sharma A, Rushton K, Lin IW, Nguyen T, Althoff T. Facilitating self-guided mental health interventions through human-language model interaction: a case study of cognitive restructuring. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems; CHI '24; May 11-16, 2024; Honolulu, HI. 2024. pp. 11–6. https://dl.acm.org/doi/10.1145/3613904.3642761 - DOI - DOI
    1. Singh OP. Artificial intelligence in the era of ChatGPT - opportunities and challenges in mental health care. Indian J Psychiatry. 2023 Mar;65(3):297–8. doi: 10.4103/indianjpsychiatry.indianjpsychiatry_112_23. https://europepmc.org/abstract/MED/37204980 IJPsy-65-297 - DOI - PMC - PubMed

MeSH terms