โก Quick Summary
This study developed and validated a self-completion questionnaire to assess the use of ChatGPT in primary and secondary disease prevention. The findings indicate that the questionnaire demonstrates good reliability and can be adapted for various conversational AI systems.
๐ Key Details
- ๐ Sample Size: 22 participants (16 female, 6 male)
- ๐งฉ Questionnaire Domains: Knowledge, attitudes, and behaviors
- โ๏ธ Reliability Metrics: Kendall’s tau for test-retest reliability, Cronbach’s Alpha for internal consistency
- ๐ Internal Consistency: Cronbach’s ฮฑ = 0.771
๐ Key Takeaways
- ๐ก ChatGPT is increasingly used for health-related guidance, raising concerns about information accuracy.
- ๐ The questionnaire effectively evaluates user interactions with ChatGPT for health prevention.
- ๐ High reliability was observed in knowledge (p < 0.01) and behavior items (ฯ = 1.00 for seven items).
- ๐ The tool can be adapted for assessing various AI systems beyond ChatGPT.
- ๐ Internal consistency values exceeded the threshold for exploratory research.
- ๐ฅ The study highlights the importance of understanding AI’s role in health maintenance.
- ๐ Validated items were derived from a systematic literature review and health literacy tools.
๐ Background
The rise of conversational AI tools like ChatGPT has transformed how individuals seek health-related information. While these platforms offer convenience and accessibility, they also pose risks regarding the accuracy of the information provided. Understanding how users engage with these tools is crucial for ensuring effective health prevention strategies.
๐๏ธ Study
This study aimed to develop a comprehensive questionnaire that evaluates the role of ChatGPT in primary and secondary health prevention. The questionnaire was designed based on a systematic literature review and included various metrics related to demographics, internet usage, and health literacy. The validation process involved a sample of 22 participants who completed the questionnaire twice, allowing for a robust analysis of reliability.
๐ Results
The results indicated that the questionnaire items exhibited significant test-retest stability, particularly in knowledge and behavior domains. Notably, seven behavior items achieved perfect reliability (ฯ = 1.00), while five others exceeded ฯ > 0.70. The internal consistency of the questionnaire was deemed acceptable, with a raw Cronbach’s ฮฑ of 0.771, indicating that the items work well together to measure the intended constructs.
๐ Impact and Implications
The implications of this study are significant, as it provides a validated tool for assessing how individuals utilize ChatGPT for health prevention. This questionnaire not only addresses key dimensions of AI use but also facilitates meaningful comparisons across diverse populations. As AI continues to play a larger role in healthcare, understanding user interactions will be essential for optimizing health outcomes and ensuring the responsible use of technology.
๐ฎ Conclusion
In conclusion, this study presents a valuable contribution to the field of health prevention by introducing a validated questionnaire that captures the use of ChatGPT. The findings underscore the potential of AI in complementing traditional health processes and highlight the need for ongoing research to explore its impact on health maintenance. As we move forward, it is crucial to continue evaluating the effectiveness and reliability of AI tools in healthcare settings.
๐ฌ Your comments
What are your thoughts on the use of AI like ChatGPT in health prevention? We would love to hear your insights! ๐ฌ Leave your comments below or connect with us on social media:
Development of a questionnaire for assessing the use of ChatGPT in primary and secondary disease prevention.
Abstract
BACKGROUND: Many individuals seek health-related guidance through ChatGPT OpenAI (San Francisco, CA, USA), due to its convenience and perceived reliability, often in place of, or as a supplement to, professional medical advice. This raises concerns about the accuracy of information provided and the potential for misinterpretation. On the other hand, ChatGPT offers a promising avenue for complementing traditional health prevention processes.
AIMS: This study aimed to develop and validate self-completion questionnaire among adults that evaluates the use of role of ChatGPT in primary and secondary health prevention, to explore the extent to which users utilize ChatGPT for disease prevention and health maintenance.
METHOD: Questionnaire items were derived from a systematic literature review and comprised demographics, internet-use metrics, and validated items from the Brief Health Literacy Screening Tool. ChatGPT usage was structured into three domains: knowledge, attitudes, and behaviors. Test-retest reliability was quantified by Kendall’s tau, and internal consistency by Cronbach’s Alpha.
RESULTS: During the validation phase, the questionnaire was administered to a sample of 22 participants (16 female, six male), each of whom completed it twice, resulting in a total of 44 responses. Knowledge items demonstrated significant test-retest stability (Kendall’s ฯ, p < 0.01). For behavior items, seven achieved perfect reliability (ฯ = 1.00), and five exceeded ฯ > 0.70. Attitude items similarly showed high stability, with three at ฯ = 1.00 and three above ฯ > 0.70. Internal consistency was acceptable (raw Cronbach’s ฮฑ = 0.771).
DISCUSSION: Our reliability analysis demonstrated that the items of the instrument exhibit good internal consistency, with Cronbach’s Alpha values exceeding the commonly accepted threshold for exploratory research. Moreover, the questionnaire’s design is inherently model-independent, allowing for its straightforward adaptation to assess user interactions with a variety of conversational artificial intelligence systems beyond ChatGPT.
CONCLUSION: In conclusion, this study presents an initially validated questionnaire that captures how individuals employ ChatGPT for both primary and secondary disease prevention. The tool addresses key dimensions of artificial intelligence use and enables meaningful comparisons across populations with different social and educational backgrounds.
Author: [‘Angyal V’, ‘Bertalan ร’, ‘Domjรกn P’, ‘Feith HJ’, ‘Dinya E’]
Journal: Front Public Health
Citation: Angyal V, et al. Development of a questionnaire for assessing the use of ChatGPT in primary and secondary disease prevention. Development of a questionnaire for assessing the use of ChatGPT in primary and secondary disease prevention. 2025; 13:1709611. doi: 10.3389/fpubh.2025.1709611