Evaluating Machine Learning Models for Mental Health Diagnostics: A Comparative Analysis and Visual Insights
DOI:
https://doi.org/10.30865/klik.v4i4.1702Keywords:
Mental Health; Machine Learning; Comparison; Random Forest; SVCAbstract
This study addresses the critical challenge of enhancing mental health diagnostics amidst a surge in global mental disorder prevalence. With mental health conditions predicted to become the leading cause of disability by 2030, there is an urgent need for more effective diagnostic methods that transcend the limitations of traditional frameworks, such as subjectivity and clinician bias. Leveraging the capabilities of machine learning (ML) to analyze complex datasets, this research aims to fill the gap in the comparative effectiveness of various ML models, particularly within the context of imbalanced mental health datasets. We systematically evaluated the performance of diverse ML models—including Random Forest, Gradient Boosting, Support Vector Machines, and others—on a rich dataset embodying a wide spectrum of symptoms and diagnoses. Through advanced data preprocessing techniques, such as innovative handling of missing values and categorical encoding, coupled with RandomizedSearchCV for model optimization, we provided a comprehensive analysis of the models' effectiveness. The application of oversampling strategies addressed the challenge of dataset imbalance, ensuring realistic clinical scenario evaluations. The study's findings are presented through detailed model performance metrics and visual analytics, such as symptom distribution visualizations and correlation cluster maps, enhancing interpretability and clinical relevance. The discussion section explores the practical applicability of these findings in clinical settings, acknowledging limitations and outlining future research directions. In conclusion, the study presents a nuanced narrative of ML model selection and performance evaluation complexities. The superior performance of ensemble methods like Random Forest and Gradient Boosting classifiers for certain diagnoses demonstrates the potential of ML in mental health diagnostics. However, the varied performance across models underscores the importance of context-specific model selection, considering the trade-offs between accuracy, interpretability, and computational efficiency. This research contributes significantly to the field of mental health diagnostics by highlighting models with the greatest promise for clinical application and by providing a framework for future advancements integrating ML into mental health diagnostics.
Downloads
References
W. Bai et al., “A joint international collaboration to address the inevitable mental health crisis in Ukraine,” Nat. Med., vol. 28, no. 6, pp. 1103–1104, 2022.
S. Shoib et al., “Suicide, stigma and COVID-19: a call for action from low and middle income countries,” Front. psychiatry, vol. 13, p. 894524, 2022.
A. Mallard, M. A. Pesantes, C. Zavaleta-Cortijo, and J. Ward, “An urgent call to collect data related to COVID-19 and Indigenous populations globally,” BMJ Glob. Heal., vol. 6, no. 3, 2021.
J. Piao et al., “Alarming changes in the global burden of mental disorders in children and adolescents from 1990 to 2019: a systematic analysis for the Global Burden of Disease study,” Eur. Child & Adolesc. Psychiatry, vol. 31, no. 11, pp. 1827–1845, 2022.
I. F. Tso and S. Park, “Alarming levels of psychiatric symptoms and the role of loneliness during the COVID-19 epidemic: A case study of Hong Kong,” Psychiatry Res., vol. 293, p. 113423, 2020.
I. Ameer, M. Arif, G. Sidorov, H. Gòmez-Adorno, and A. Gelbukh, “Mental illness classification on social media texts using deep learning and transfer learning,” arXiv Prepr. arXiv2207.01012, 2022.
S. Gorrell, E. E. Reilly, L. Brosof, and D. Le Grange, “Use of telehealth in the management of adolescent eating disorders: patient perspectives and future directions suggested from the COVID-19 pandemic,” Adolesc. Health. Med. Ther., pp. 45–53, 2022.
D. Giansanti, “An Umbrella Review of the Fusion of fMRI and AI in Autism,” Diagnostics, vol. 13, no. 23, p. 3552, 2023.
V. M. Saceleanu et al., “Integrative approaches in acute ischemic stroke: from symptom recognition to future innovations,” Biomedicines, vol. 11, no. 10, p. 2617, 2023.
B. N. E. Quinn, “An analysis of the acceptability, feasibility, and utility of the Global Mental Health Assessment Tool for Primary Care (GMHAT/PC) in a UK primary healthcare setting: a practice-based mixed methods study,” 2021.
E. Freeman et al., “Patient-identified burden and unmet needs in patients with cluster headache: An evidence-based qualitative literature review,” Cephalalgia Reports, vol. 5, p. 25158163221096864, 2022.
R. R. Buxbaum, “Everything won’t be okay: The impact of therapists’ justification of the mental healthcare system on their racially minoritized patients,” Long Island University, Brooklyn, 2023.
C. Guo, H. Ashrafian, S. Ghafur, G. Fontana, C. Gardner, and M. Prime, “Challenges for the evaluation of digital health solutions—A call for innovative evidence generation approaches,” NPJ Digit. Med., vol. 3, no. 1, p. 110, 2020.
L. E. Lwakatare, A. Raj, I. Crnkovic, J. Bosch, and H. H. Olsson, “Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions,” Inf. Softw. Technol., vol. 127, p. 106368, 2020.
K. D. Davis et al., “Discovery and validation of biomarkers to aid the development of safe and effective pain therapeutics: challenges and opportunities,” Nat. Rev. Neurol., vol. 16, no. 7, pp. 381–400, 2020.
R. Gupta, S. Kumari, A. Senapati, R. K. Ambasta, and P. Kumar, “New era of artificial intelligence and machine learning-based detection, diagnosis, and therapeutics in Parkinson’s disease,” Ageing Res. Rev., p. 102013, 2023.
M. Yagi, K. Yamanouchi, N. Fujita, H. Funao, and S. Ebata, “Revolutionizing Spinal Care: Current Applications and Future Directions of Artificial Intelligence and Machine Learning,” J. Clin. Med., vol. 12, no. 13, p. 4188, 2023.
U. Ullah and B. Garcia-Zapirain, “Quantum Machine Learning Revolution in Healthcare: A Systematic Review of Emerging Perspectives and Applications,” IEEE Access, 2024.
M. A. Myszczynska et al., “Applications of machine learning to diagnosis and treatment of neurodegenerative diseases,” Nat. Rev. Neurol., vol. 16, no. 8, pp. 440–456, 2020.
R. Thirunavukarasu, R. Gnanasambandan, M. Gopikrishnan, V. Palanisamy, and others, “Towards computational solutions for precision medicine based big data healthcare system using deep learning models: A review,” Comput. Biol. Med., p. 106020, 2022.
E. Badidi, “Edge AI for early detection of chronic diseases and the spread of infectious diseases: opportunities, challenges, and future directions,” Futur. Internet, vol. 15, no. 11, p. 370, 2023.
N. K. Iyortsuun, S.-H. Kim, M. Jhon, H.-J. Yang, and S. Pant, “A Review of Machine Learning and Deep Learning Approaches on Mental Health Diagnosis,” in Healthcare, 2023, vol. 11, no. 3, p. 285.
J. Chung and J. Teo, “Mental health prediction using machine learning: taxonomy, applications, and challenges,” Appl. Comput. Intell. Soft Comput., vol. 2022, pp. 1–19, 2022.
L. S. Khoo, M. K. Lim, C. Y. Chong, and R. McNaney, “Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing Approaches,” Sensors, vol. 24, no. 2, p. 348, 2024.
J. R. A. Solares et al., “Deep learning for electronic health records: A comparative review of multiple deep neural architectures,” J. Biomed. Inform., vol. 101, p. 103337, 2020.
F. Thabtah, S. Hammoud, F. Kamalov, and A. Gonsalves, “Data imbalance in classification: Experimental evaluation,” Inf. Sci. (Ny)., vol. 513, pp. 429–441, 2020.
H. El Haji et al., “Evolution of Breast Cancer Recurrence Risk Prediction: A Systematic Review of Statistical and Machine Learning--Based Models,” JCO Clin. Cancer Informatics, vol. 7, p. e2300049, 2023.
W. H. Organization and others, “World mental health report: transforming mental health for all,” 2022.
D. Godini? and B. Obrenovic, “Effects of economic uncertainty on mental health in the COVID-19 pandemic context: social identity disturbance, job uncertainty and psychological well-being model,” 2020.
I. Coppola, N. Rania, R. Parisi, and F. Lagomarsino, “Spiritual well-being and mental health during the COVID-19 pandemic in Italy,” Front. Psychiatry, vol. 12, p. 626944, 2021.
S. Vatansever et al., “Artificial intelligence and machine learning-aided drug discovery in central nervous system diseases: State-of-the-arts and future directions,” Med. Res. Rev., vol. 41, no. 3, pp. 1427–1473, 2021.
S. Neethirajan, “Artificial Intelligence and Sensor Innovations: Enhancing Livestock Welfare with a Human-Centric Approach,” Human-Centric Intell. Syst., pp. 1–16, 2023.
F. Sabah, Y. Chen, Z. Yang, M. Azam, N. Ahmad, and R. Sarwar, “Model optimization techniques in personalized federated learning: A survey,” Expert Syst. Appl., p. 122874, 2023.
V. Garc’ia, J. S. Sánchez, A. I. Marqués, R. Florencia, and G. Rivera, “Understanding the apparent superiority of over-sampling through an analysis of local information for class-imbalanced data,” Expert Syst. Appl., vol. 158, p. 113026, 2020.
M. E. Paoletti, O. Mogollon, S. Moreno, J. C. Sancho, and J. M. Haut, “A Comprehensive Survey of Imbalance Correction Techniques for Hyperspectral Data Classification,” IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens., 2023.
Programmerrdai, “Mental Disorder Classification.” 2021.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Evaluating Machine Learning Models for Mental Health Diagnostics: A Comparative Analysis and Visual Insights
ARTICLE HISTORY
Issue
Section
Copyright (c) 2024 Gregorius Airlangga
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
