โก Quick Summary
A recent study compared the performance of two AI-driven chatbots, ChatGPT and Gemini, in delivering asthma-related health information. ChatGPT achieved an impressive 96.3% accuracy, while Gemini followed closely with 92.6% accuracy, highlighting the potential of AI in enhancing asthma health literacy.
๐ Key Details
- ๐ Study Design: Cross-sectional analysis of AI responses to asthma-related questions.
- ๐งฉ Assessment Tool: Patient-completed Asthma Knowledge Questionnaire.
- โ๏ธ AI Models: ChatGPT (version 4.0) and Gemini (version 1.2).
- ๐ Performance Metrics: ChatGPT: 96.3% accuracy; Gemini: 92.6% accuracy.
๐ Key Takeaways
- ๐ค AI chatbots can provide real-time, evidence-based asthma information.
- ๐ High accuracy of both models suggests reliability in health education.
- ๐ก ChatGPT outperformed Gemini, but both showed strong potential.
- ๐ Cohen’s kappa indicated near-perfect agreement for ChatGPT (ฮบ=0.91) and strong agreement for Gemini (ฮบ=0.82).
- ๐ AI’s role in personalized medicine could enhance patient engagement and self-management.
- ๐ No significant difference in performance (p=0.67) between the two models.
- ๐ Study published in the Journal of Asthma, emphasizing the importance of AI in chronic disease management.
๐ Background
Asthma is a chronic disease affecting over 300 million individuals globally, characterized by its complexity and variability. Despite advancements in treatment, many patients struggle with disease control, highlighting the need for innovative educational tools. AI-driven chatbots like ChatGPT and Gemini offer promising solutions by providing accessible, personalized health information to patients.
๐๏ธ Study
The study aimed to evaluate the accuracy of ChatGPT and Gemini in delivering asthma-related health information. Researchers utilized the Patient-completed Asthma Knowledge Questionnaire, a validated tool, to assess the responses of both AI models to 54 standardized questions. This comparative analysis sought to determine the reliability of AI-generated medical content in enhancing asthma health literacy.
๐ Results
ChatGPT achieved an accuracy of 96.3% (52 out of 54 correct responses), while Gemini scored 92.6% (50 out of 54 correct). The statistical analysis revealed no significant difference in performance between the two models (p=0.67). Cohen’s kappa values indicated a high level of agreement, with ChatGPT demonstrating near-perfect agreement and Gemini showing strong agreement.
๐ Impact and Implications
The findings of this study underscore the potential of AI chatbots in improving asthma health literacy. By providing accurate, real-time information, these tools can empower patients to manage their condition more effectively. As healthcare continues to evolve towards personalized medicine, integrating AI into patient education could significantly enhance engagement and treatment adherence, ultimately leading to better health outcomes.
๐ฎ Conclusion
This study highlights the remarkable capabilities of AI in delivering accurate health information for asthma management. With ChatGPT and Gemini demonstrating high accuracy, the integration of AI into patient education represents a significant step forward in chronic disease management. Continued research and development in this area could pave the way for more personalized and effective healthcare solutions.
๐ฌ Your comments
What are your thoughts on the use of AI in healthcare, particularly in managing chronic diseases like asthma? We invite you to share your insights and engage in the conversation! ๐ฌ Leave your comments below or connect with us on social media:
Artificial intelligence in asthma health literacy: a comparative analysis of ChatGPT versus Gemini.
Abstract
BACKGROUND: Asthma is a complex and heterogeneous chronic disease affecting over 300 million individuals worldwide. Despite advances in pharmacotherapy, poor disease control remains a major challenge, necessitating innovative approaches to patient education and self-management. Artificial intelligence driven chatbots, such as ChatGPT and Gemini, have the potential to enhance asthma care by providing real-time, evidence-based information. As asthma management moves toward personalized medicine, AI could support individualized education and treatment guidance. However, concerns remain regarding the accuracy and reliability of AI-generated medical content.
OBJECTIVE: This study evaluated the accuracy of ChatGPT (version 4.0) and Gemini (version 1.2) in providing asthma-related health information using the Patient-completed Asthma Knowledge Questionnaire, a validated asthma literacy tool.
METHODS: A cross-sectional study was conducted in which both AI models answered 54 standardized asthma-related items. Responses were classified as correct or incorrect based on alignment with validated clinical knowledge. Accuracy was assessed using descriptive statistics, Cohen’s kappa for inter-model agreement, and chi-square tests for comparative performance.
RESULTS: ChatGPT achieved an accuracy of 96.3% (52/54 correct; 95% CI: 87.5%-99.0%), while Gemini scored 92.6% (50/54 correct; 95% CI: 82.5%-97.1%), with no statistically significant difference (pโ=โ0.67). Cohen’s kappa demonstrated near-perfect agreement for ChatGPT (ฮบโ=โ0.91) and strong agreement for Gemini (ฮบโ=โ0.82).
CONCLUSION: ChatGPT and Gemini demonstrated high accuracy in delivering asthma-related health information, supporting their potential as adjunct tools for patient education. AI models could potentially play a role in personalized asthma management by providing tailored treatment guidance and improving patient engagement.
Author: [‘Hรธj S’, ‘Backer V’, ‘Ulrik CS’, ‘Sigsgaard T’, ‘Meteran H’]
Journal: J Asthma
Citation: Hรธj S, et al. Artificial intelligence in asthma health literacy: a comparative analysis of ChatGPT versus Gemini. Artificial intelligence in asthma health literacy: a comparative analysis of ChatGPT versus Gemini. 2025; (unknown volume):1-7. doi: 10.1080/02770903.2025.2495729