๐Ÿง‘๐Ÿผโ€๐Ÿ’ป Research - September 30, 2025

Evaluation of scientific validity and appropriateness of artificial intelligence-assisted ChatGPT advices in dietary treatment of methylmalonic acidemia.

๐ŸŒŸ Stay Updated!
Join AI Health Hub to receive the latest insights in health and AI.

โšก Quick Summary

This study evaluated the scientific validity and appropriateness of dietary advice provided by ChatGPT for patients with methylmalonic acidemia (MMA). The findings revealed that only 20% of the responses were appropriate, highlighting significant limitations in AI-generated dietary recommendations.

๐Ÿ” Key Details

  • ๐Ÿ“Š Focus: Dietary treatment for methylmalonic acidemia (MMA)
  • ๐Ÿค– AI Tool: ChatGPT version 4.0
  • ๐Ÿ‘ฉโ€โš•๏ธ Evaluation Team: Dietitians and metabolic physicians
  • ๐Ÿ“… Study Date: October 2024

๐Ÿ”‘ Key Takeaways

  • ๐Ÿ“‰ Low Appropriateness Rate: Only 20.0% of ChatGPT’s dietary advice was deemed appropriate.
  • ๐Ÿšซ High Inappropriateness Rate: 53.4% of responses were considered inappropriate.
  • โš ๏ธ Critical for MMA Patients: Dietary therapy is the only known treatment for MMA, making accurate advice essential.
  • ๐Ÿง‘โ€โš•๏ธ Human Expertise Needed: The study emphasizes the need for human oversight in dietary recommendations.
  • ๐Ÿ” First of Its Kind: This research is the first to assess AI advice for specialized dietary management of inherited metabolic disorders.
  • ๐Ÿ’ก Future of AI: The findings suggest that AI may not replace human expertise in healthcare anytime soon.

๐Ÿ“š Background

Methylmalonic acidemia (MMA) is a rare inherited metabolic disorder that requires strict dietary management to prevent serious health complications. With the rise of artificial intelligence tools like ChatGPT, patients and healthcare professionals are increasingly turning to AI for health and nutrition advice. However, concerns have been raised regarding the accuracy and reliability of such AI-generated recommendations.

๐Ÿ—’๏ธ Study

The study aimed to evaluate the dietary advice provided by ChatGPT for patients with MMA by comparing its recommendations against internationally recognized guidelines and current literature. A team of dietitians and metabolic physicians analyzed ChatGPT’s responses to two specific cases of MMA, assessing the appropriateness of the dietary therapy suggested.

๐Ÿ“ˆ Results

The results indicated that while ChatGPT provided clear advice, the overall appropriateness was low. Only 20.0% of the dietary recommendations were appropriate, while a concerning 53.4% were inappropriate. This raises significant questions about the reliability of AI in providing dietary therapy for patients whose treatment relies solely on nutrition.

๐ŸŒ Impact and Implications

The implications of this study are profound. It underscores the limitations of AI in specialized healthcare settings, particularly in areas where individualized treatment is crucial. The findings suggest that while AI can assist in generating information, it cannot replace the nuanced understanding and expertise of healthcare professionals. This study serves as a reminder of the importance of human oversight in dietary management, especially for complex metabolic disorders like MMA.

๐Ÿ”ฎ Conclusion

This study highlights the significant limitations of AI-generated dietary advice for patients with methylmalonic acidemia. With only 20% of recommendations deemed appropriate, it is clear that AI cannot yet replace human expertise in healthcare. As we continue to explore the integration of AI in medical fields, further research is essential to enhance the accuracy and reliability of these technologies.

๐Ÿ’ฌ Your comments

What are your thoughts on the use of AI in dietary management for metabolic disorders? Let’s engage in a discussion! ๐Ÿ’ฌ Share your insights in the comments below or connect with us on social media:

Evaluation of scientific validity and appropriateness of artificial intelligence-assisted ChatGPT advices in dietary treatment of methylmalonic acidemia.

Abstract

BACKGROUND AND OBJECTIVES: Chat Generative Pretrained Transformer (ChatGPT) has become an increasingly popular way for patients and healthcare professionals to seek information on health and nutrition advice. Previous studies have raised concerns about the accuracy of dietary advice provided by ChatGPT. We aimed to evaluate the potential of ChatGPT as a tool to provide dietary therapy for methylmalonic acidemia (MMA) in October 2024.
METHODS AND STUDY DESIGN: we compared ChatGPT’s (version 4.0) dietary advices for MMA with internationally recognized guidelines and current literature, and then evaluated the chatbot’s ability to generate dietary therapy in two different cases with MMA. A team of dietitians and metabolic physicians compared ChatGPT responses to disease-specific guidelines and evidence-based resources.
RESULTS: overall, ChatGPT provided clear advices: 20.0 % of responses were considered appropriate and 53.4 % were considered inappropriate. Especially in this group of patients whose only known treatment was dietary therapy, the dietary therapy recommended by ChatGPT was also inappropriate for the two cases in question.
CONCLUSIONS: this study was the first to evaluate the appropriateness of artificial intelligence advices for specialized dietary management of inherited metabolic disorders. Consequently, the idea that artificial intelligence can replace human labor in the near future seems far-fetched, given the low success rate of even a diagnosis with such a clear mechanism and treatment, and individualized treatment approaches.

Author: [‘Yolcu F’, ‘Koรง Yekedรผz M’, ‘Kรถse E’, ‘Gรผlhan Samur F’, ‘EminoฤŸlu FT’]

Journal: Nutr Hosp

Citation: Yolcu F, et al. Evaluation of scientific validity and appropriateness of artificial intelligence-assisted ChatGPT advices in dietary treatment of methylmalonic acidemia. Evaluation of scientific validity and appropriateness of artificial intelligence-assisted ChatGPT advices in dietary treatment of methylmalonic acidemia. 2025; (unknown volume):(unknown pages). doi: 10.20960/nh.06026

Share on facebook
Facebook
Share on twitter
Twitter
Share on linkedin
LinkedIn
Share on whatsapp
WhatsApp

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.