⚡ Quick Summary
This systematic review evaluates the current state of guidelines and frameworks for artificial intelligence (AI) in medicine, highlighting the need for robust standards to address the evolving challenges of AI implementation. The findings reveal significant variability in applicability and rigor of development among existing guidelines.
🔍 Key Details
- 📊 Initial Search: 4,975 studies identified from databases, plus 7 from manual search.
- 📝 Selected Articles: 11 articles met the eligibility criteria for data extraction.
- ⚙️ Assessment Tool: Appraisal of Guidelines, Research, and Evaluation II (AGREE II).
- 🏆 High-Quality Initiatives: TRIPOD+AI, DECIDE-AI, SPIRIT-AI, and CONSORT-AI.
🔑 Key Takeaways
- 📈 Guidelines generally excel in scope, purpose, and editorial independence.
- ⚠️ Significant variability exists in applicability and rigor of guideline development.
- 🤝 Stakeholder involvement is a strong point in well-established initiatives.
- 🌱 Ethical and environmental aspects of AI in medicine require further attention.
- 🔄 Need for integrated reporting guidelines that promote Findability, Accessibility, Interoperability, and Reusability.
- 🌍 Cultural shift towards transparency and open science is essential for sustainable digital health research.
📚 Background
The integration of artificial intelligence into clinical practice is rapidly advancing, yet it brings forth a myriad of challenges. The necessity for up-to-date and comprehensive guidelines is paramount to ensure that AI technologies are implemented effectively and ethically in medical settings. This review aims to assess the quality of existing guidelines and frameworks, providing insights into best practices and recommendations for future developments.
🗒️ Study
The systematic review was conducted using the AGREE II tool to evaluate the quality of guidelines across six domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence. The study protocol was published prior to the review, ensuring transparency in the methodology.
📈 Results
Out of the initial 4,975 studies, only 11 articles were selected for detailed analysis. The results indicated that while guidelines performed well in terms of scope and editorial independence, there was notable inconsistency in their applicability and development rigor. Initiatives like TRIPOD+AI and CONSORT-AI were highlighted for their high quality, particularly in engaging stakeholders effectively.
🌍 Impact and Implications
The findings of this review underscore the critical need for comprehensive and integrated reporting guidelines in AI medicine. By adhering to principles of Findability, Accessibility, Interoperability, and Reusability, the medical community can foster a culture of transparency and open science. This shift is vital for advancing sustainable digital health research and ensuring that AI technologies are used responsibly and effectively in clinical settings.
🔮 Conclusion
This systematic review sheds light on the current landscape of AI guidelines in medicine, revealing both strengths and weaknesses. The call for improved standards and frameworks is clear, as is the need for ongoing collaboration between the medical and AI communities. As we move forward, embracing these changes will be essential for harnessing the full potential of AI in healthcare.
💬 Your comments
What are your thoughts on the current guidelines for AI in medicine? How do you think we can improve them? 💬 Join the conversation in the comments below or connect with us on social media:
Guidelines and standard frameworks for artificial intelligence in medicine: a systematic review.
Abstract
OBJECTIVES: The continuous integration of artificial intelligence (AI) into clinical settings requires the development of up-to-date and robust guidelines and standard frameworks that consider the evolving challenges of AI implementation in medicine. This review evaluates the quality of these guideline and summarizes ethical frameworks, best practices, and recommendations.
MATERIALS AND METHODS: The Appraisal of Guidelines, Research, and Evaluation II tool was used to assess the quality of guidelines based on 6 domains: scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence. The protocol of this review including the eligibility criteria, the search strategy data extraction sheet and methods, was published prior to the actual review with International Registered Report Identifier of DERR1-10.2196/47105.
RESULTS: The initial search resulted in 4975 studies from 2 databases and 7 studies from manual search. Eleven articles were selected for data extraction based on the eligibility criteria. We found that while guidelines generally excel in scope, purpose, and editorial independence, there is significant variability in applicability and the rigor of guideline development. Well-established initiatives such as TRIPOD+AI, DECIDE-AI, SPIRIT-AI, and CONSORT-AI have shown high quality, particularly in terms of stakeholder involvement. However, applicability remains a prominent challenge among the guidelines. The result also showed that the reproducibility, ethical, and environmental aspects of AI in medicine still need attention from both medical and AI communities.
DISCUSSION: Our work highlights the need for working toward the development of integrated and comprehensive reporting guidelines that adhere to the principles of Findability, Accessibility, Interoperability and Reusability. This alignment is essential for fostering a cultural shift toward transparency and open science, which are pivotal milestone for sustainable digital health research.
CONCLUSION: This review evaluates the current reporting guidelines, discussing their advantages as well as challenges and limitations.
Author: [‘Shiferaw KB’, ‘Roloff M’, ‘Balaur I’, ‘Welter D’, ‘Waltemath D’, ‘Zeleke AA’]
Journal: JAMIA Open
Citation: Shiferaw KB, et al. Guidelines and standard frameworks for artificial intelligence in medicine: a systematic review. Guidelines and standard frameworks for artificial intelligence in medicine: a systematic review. 2025; 8:ooae155. doi: 10.1093/jamiaopen/ooae155