Adaptive Chatbot Significantly Surpasses ChatGPT at Teaching and
Assessing User Knowledge about Mental Health and Problematic Social
Media Usage

Zarah Koroth, Anvi Allada; John Leddo

doi:10.46609/IJSSER.2026.v11i06.025

Title: Adaptive Chatbot Significantly Surpasses ChatGPT at Teaching and Assessing User Knowledge about Mental Health and Problematic Social Media Usage
Authors: Zarah Koroth, Anvi Allada and John Leddo
Journal: International Journal of Social Science and Economic Research (IJSSER) ISSN: 2455-8834 Volume: 11 Issue: 6 Publication Date: July 2026 DOI: 10.46609/IJSSER.2026.v11i06.025
\|\| \|\|
Zarah Koroth, Anvi Allada and John Leddo MyEdMaster, LCC Virginia, USA
MLA 8 Koroth, Zarah, et al. "Adaptive Chatbot Significantly Surpasses ChatGPT at Teaching and Assessing User Knowledge about Mental Health and Problematic Social Media Usage." Int. j. of Social Science and Economic Research, vol. 11, no. 6, June 2026, pp. 2819-2829, doi.org/10.46609/IJSSER.2026.v11i06.025. Accessed June 2026. APA 6 Koroth, Z., Allada, A., & Leddo, J. (2026, June). Adaptive Chatbot Significantly Surpasses ChatGPT at Teaching and Assessing User Knowledge about Mental Health and Problematic Social Media Usage. Int. j. of Social Science and Economic Research, 11(6), 2819-2829. Retrieved from https://doi.org/10.46609/IJSSER.2026.v11i06.025 Chicago Koroth, Zarah, Anvi Allada, and John Leddo. "Adaptive Chatbot Significantly Surpasses ChatGPT at Teaching and Assessing User Knowledge about Mental Health and Problematic Social Media Usage." Int. j. of Social Science and Economic Research 11, no. 6 (June 2026), 2819-2829. Accessed June, 2026. https://doi.org/10.46609/IJSSER.2026.v11i06.025.
References [1] . Abd-alrazaq, A. A., Househ, M., Gardner, P., Bewick, B. M., Alalwan, A. A., & Alajlani, M. (n.d.). An Overview of the Features of Chatbots in Mental Health: A Scoping Review - ScienceDirect. ScienceDirect. https://www.sciencedirect.com/science/article/abs/pii/S1386505619307166 [2] . Faverio, M., Anderson, M., & Park, E. (2025, April 22). Social Media and Teens’ Mental Health: What Teens and their Parents Say. Pew Research Center. https://www.pewresearch.org/internet/2025/04/22/teens-social-media-and-mental-health/ [3] . Feng, X., Tian, L., Ho, G. W. K., Yorke, J., & Hui, V. (2025, November 26). The Effectiveness of AI Chatbots in Alleviating Mental Distress and Promoting Health Behaviors Among Adolescents and Young Adults: Systematic Review and Meta-Analysis. Journal of Medical Internet Research. https://www.jmir.org/2025/1/e79850 [4] . Haque, M. D. R., & Rubya, S. (2023, May 22). An Overview of Chatbot-based Mobile Mental Health Apps: Insights From App Description and User Reviews. JMIR mHealth and uHealth. https://pmc.ncbi.nlm.nih.gov/articles/PMC10242473/ [5] . Khalaf, A. M., Alubied, A. A., Khalaf, A. M., & Rifaey, A. A. (2023, August 5). The Impact of Social Media on the Mental Health of Adolescents and Young Adults: A Systematic Review. Cureus. https://pmc.ncbi.nlm.nih.gov/articles/PMC10476631/#sec1 [6] . Laun, M., & Wolff, F. (2025, February 5). Chatbots in Education: Hype or Help? A Meta-Analysis - ScienceDirect. ScienceDirect. https://www.sciencedirect.com/science/article/pii/S1041608025000226 [7] . Siliezar, J. (2026, May 18). One in eight adolescents and young adults use AI chatbots for Mental Health Advice. School of Public Health \| Brown University. https://sph.brown.edu/news/2025-11-18/teens-ai-chatbots [8] . Wells, S. (n.d.). Exploring the Dangers of AI in Mental Health Care. Stanford HAI. https://hai.stanford.edu/news/exploring-the-dangers-of-ai-in-mental-health-care
ABSTRACT: Personal assistants, chatbots, and large language models (LLMs) increasingly pervade our society. While their main function for people is to answer questions by providing information, a new area of focus and issues was identified in this experiment. There were two main issues identified: namely, that chatbots do not adjust their responses to the user and their background, and that user comprehension is not assessed and responses therefore do not adjust to that comprehension. In this experiment, a self-assessment chatbot was created to attempt to solve this issue. 9 middle school and high school students in the United States were randomly assigned to a control group and an experimental group. Each group was given an instructional document containing information about teen mental health and social media usage. The control group was given Chat GPT to study with and the experimental group was given our self-assessment chatbot. Finally, each group was given the same posttest, scored out of 15 points. This posttest contained 15 questions about the subject material. Results showed statistically significant evidence that students who used the self-assessment chatbot scored, on average, 20.7 percentage points higher than those who used Chat GPT to study, equivalent to about 2 letter grades higher.

IJSSER is Member of