FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare
0
🚀
Sign in to get full access
Overview
- Major advancements in artificial intelligence (AI) for medicine and healthcare have not yet led to widespread real-world clinical deployment and adoption.
- Concerns have been raised about the technical, clinical, ethical, and legal risks associated with medical AI.
- To increase real-world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organizations, and authorities.
Plain English Explanation
The paper describes the FUTURE-AI guideline, which is the first international consensus framework for developing and deploying trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and includes 118 interdisciplinary experts from 51 countries.
Over two years, the consortium defined guiding principles and best practices for trustworthy medical AI through an extensive review of the literature, a survey, and online meetings. The FUTURE-AI framework is based on six key principles: Fairness, Universality, Traceability, Usability, Robustness, and Explainability. The consortium also developed 28 best practices covering the technical, clinical, legal, and ethical aspects of medical AI throughout its lifecycle.
The goal is to provide a structured approach for creating medical AI tools that will be trusted, deployed, and adopted in real-world practice. Researchers are encouraged to apply these recommendations during the proof-of-concept stage to facilitate the future translation of medical AI into clinical use.
Technical Explanation
The paper outlines the development of the FUTURE-AI guideline, which aims to address the limited real-world adoption of medical AI technologies despite major advancements in the field. The authors note that concerns have been raised about the technical, clinical, ethical, and legal risks associated with medical AI, and that it is essential for these tools to be trusted and accepted by key stakeholders to increase adoption.
The FUTURE-AI consortium was formed in 2021 and comprises 118 interdisciplinary experts from 51 countries, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium conducted an in-depth literature review, a modified Delphi survey, and online consensus meetings to define the guiding principles and best practices for trustworthy medical AI.
The FUTURE-AI framework is based on six key principles:
- Fairness: Ensuring AI systems do not discriminate and are equitable for all users.
- Universality: Making AI tools accessible and usable by diverse populations.
- Traceability: Providing transparency about how AI systems make decisions.
- Usability: Ensuring AI tools are easy for clinicians and patients to use.
- Robustness: Ensuring AI systems are reliable, secure, and resistant to manipulation.
- Explainability: Enabling users to understand how AI systems reach their outputs.
Through consensus, the consortium also defined 28 best practices covering the technical, clinical, legal, and socio-ethical aspects of medical AI throughout its lifecycle, from design and development to regulation, deployment, and monitoring.
Critical Analysis
The FUTURE-AI guideline provides a comprehensive and structured approach for developing trustworthy medical AI systems, addressing key concerns that have limited real-world adoption. By incorporating input from a diverse, international group of experts, the guideline aims to be risk-informed and assumption-free, increasing the likelihood of acceptance by various stakeholders.
One potential limitation is that the guideline is broad and high-level, requiring further refinement and translation into specific implementation details for different medical AI use cases. Additionally, the effectiveness of the guideline in driving increased real-world adoption of medical AI remains to be seen and will require ongoing evaluation and iteration.
Further research could explore how the FUTURE-AI principles and best practices are being applied in practice, the challenges encountered, and the measurable impact on trust and adoption. Expanding the guideline to address emerging issues, such as the use of medical AI in low-resource and underserved settings, could also be valuable.
Conclusion
The FUTURE-AI guideline represents a significant step towards increasing the real-world deployment and adoption of trustworthy medical AI systems. By defining a comprehensive set of guiding principles and best practices, the guideline provides a structured approach for developing AI tools that are fair, universal, traceable, usable, robust, and explainable.
If widely adopted, the FUTURE-AI framework has the potential to enhance trust in medical AI among patients, clinicians, health organizations, and regulatory bodies, ultimately leading to greater integration of these technologies into clinical practice and improved healthcare outcomes.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🚀
0
FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare
Karim Lekadir, Aasa Feragen, Abdul Joseph Fofanah, Alejandro F Frangi, Alena Buyx, Anais Emelie, Andrea Lara, Antonio R Porras, An-Wen Chan, Arcadi Navarro, Ben Glocker, Benard O Botwe, Bishesh Khanal, Brigit Beger, Carol C Wu, Celia Cintas, Curtis P Langlotz, Daniel Rueckert, Deogratias Mzurikwao, Dimitrios I Fotiadis, Doszhan Zhussupov, Enzo Ferrante, Erik Meijering, Eva Weicken, Fabio A Gonz'alez, Folkert W Asselbergs, Fred Prior, Gabriel P Krestin, Gary Collins, Geletaw S Tegenaw, Georgios Kaissis, Gianluca Misuraca, Gianna Tsakou, Girish Dwivedi, Haridimos Kondylakis, Harsha Jayakody, Henry C Woodruf, Horst Joachim Mayer, Hugo JWL Aerts, Ian Walsh, Ioanna Chouvarda, Ir`ene Buvat, Isabell Tributsch, Islem Rekik, James Duncan, Jayashree Kalpathy-Cramer, Jihad Zahir, Jinah Park, John Mongan, Judy W Gichoya, Julia A Schnabel, Kaisar Kushibar, Katrine Riklund, Kensaku Mori, Kostas Marias, Lameck M Amugongo, Lauren A Fromont, Lena Maier-Hein, Leonor Cerd'a Alberich, Leticia Rittner, Lighton Phiri, Linda Marrakchi-Kacem, Llu'is Donoso-Bach, Luis Mart'i-Bonmat'i, M Jorge Cardoso, Maciej Bobowicz, Mahsa Shabani, Manolis Tsiknakis, Maria A Zuluaga, Maria Bielikova, Marie-Christine Fritzsche, Marina Camacho, Marius George Linguraru, Markus Wenzel, Marleen De Bruijne, Martin G Tolsgaard, Marzyeh Ghassemi, Md Ashrafuzzaman, Melanie Goisauf, Mohammad Yaqub, M'onica Cano Abad'ia, Mukhtar M E Mahmoud, Mustafa Elattar, Nicola Rieke, Nikolaos Papanikolaou, Noussair Lazrak, Oliver D'iaz, Olivier Salvado, Oriol Pujol, Ousmane Sall, Pamela Guevara, Peter Gordebeke, Philippe Lambin, Pieta Brown, Purang Abolmaesumi, Qi Dou, Qinghua Lu, Richard Osuala, Rose Nakasi, S Kevin Zhou, Sandy Napel, Sara Colantonio, Shadi Albarqouni, Smriti Joshi, Stacy Carter, Stefan Klein, Steffen E Petersen, Susanna Auss'o, Suyash Awate, Tammy Riklin Raviv, Tessa Cook, Tinashe E M Mutsvangwa, Wendy A Rogers, Wiro J Niessen, X`enia Puig-Bosch, Yi Zeng, Yunusa G Mohammed, Yves Saint James Aquino, Zohaib Salahuddin, Martijn P A Starmans
Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI.
Read more7/9/2024
🤖
0
Towards Clinical AI Fairness: Filling Gaps in the Puzzle
Mingxuan Liu, Yilin Ning, Salinelat Teixayavong, Xiaoxuan Liu, Mayli Mertens, Yuqing Shang, Xin Li, Di Miao, Jie Xu, Daniel Shu Wei Ting, Lionel Tim-Ee Cheng, Jasmine Chiat Ling Ong, Zhen Ling Teo, Ting Fang Tan, Narrendar RaviChandran, Fei Wang, Leo Anthony Celi, Marcus Eng Hock Ong, Nan Liu
The ethical integration of Artificial Intelligence (AI) in healthcare necessitates addressing fairness-a concept that is highly context-specific across medical fields. Extensive studies have been conducted to expand the technical components of AI fairness, while tremendous calls for AI fairness have been raised from healthcare. Despite this, a significant disconnect persists between technical advancements and their practical clinical applications, resulting in a lack of contextualized discussion of AI fairness in clinical settings. Through a detailed evidence gap analysis, our review systematically pinpoints several deficiencies concerning both healthcare data and the provided AI fairness solutions. We highlight the scarcity of research on AI fairness in many medical domains where AI technology is increasingly utilized. Additionally, our analysis highlights a substantial reliance on group fairness, aiming to ensure equality among demographic groups from a macro healthcare system perspective; in contrast, individual fairness, focusing on equity at a more granular level, is frequently overlooked. To bridge these gaps, our review advances actionable strategies for both the healthcare and AI research communities. Beyond applying existing AI fairness methods in healthcare, we further emphasize the importance of involving healthcare professionals to refine AI fairness concepts and methods to ensure contextually relevant and ethically sound AI applications in healthcare.
Read more5/29/2024
0
Global AI Governance in Healthcare: A Cross-Jurisdictional Regulatory Analysis
Attrayee Chakraborty, Mandar Karhade
Artificial Intelligence (AI) is being adopted across the world and promises a new revolution in healthcare. While AI-enabled medical devices in North America dominate 42.3% of the global market, the use of AI-enabled medical devices in other countries is still a story waiting to be unfolded. We aim to delve deeper into global regulatory approaches towards AI use in healthcare, with a focus on how common themes are emerging globally. We compare these themes to the World Health Organization's (WHO) regulatory considerations and principles on ethical use of AI for healthcare applications. Our work seeks to take a global perspective on AI policy by analyzing 14 legal jurisdictions including countries representative of various regions in the world (North America, South America, South East Asia, Middle East, Africa, Australia, and the Asia-Pacific). Our eventual goal is to foster a global conversation on the ethical use of AI in healthcare and the regulations that will guide it. We propose solutions to promote international harmonization of AI regulations and examine the requirements for regulating generative AI, using China and Singapore as examples of countries with well-developed policies in this area.
Read more6/14/2024
✅
0
AI-Driven Healthcare: A Survey on Ensuring Fairness and Mitigating Bias
Sribala Vidyadhari Chinta, Zichong Wang, Xingyu Zhang, Thang Doan Viet, Ayesha Kashif, Monique Antoinette Smith, Wenbin Zhang
Artificial intelligence (AI) is rapidly advancing in healthcare, enhancing the efficiency and effectiveness of services across various specialties, including cardiology, ophthalmology, dermatology, emergency medicine, etc. AI applications have significantly improved diagnostic accuracy, treatment personalization, and patient outcome predictions by leveraging technologies such as machine learning, neural networks, and natural language processing. However, these advancements also introduce substantial ethical and fairness challenges, particularly related to biases in data and algorithms. These biases can lead to disparities in healthcare delivery, affecting diagnostic accuracy and treatment outcomes across different demographic groups. This survey paper examines the integration of AI in healthcare, highlighting critical challenges related to bias and exploring strategies for mitigation. We emphasize the necessity of diverse datasets, fairness-aware algorithms, and regulatory frameworks to ensure equitable healthcare delivery. The paper concludes with recommendations for future research, advocating for interdisciplinary approaches, transparency in AI decision-making, and the development of innovative and inclusive AI applications.
Read more7/30/2024