Promoting AI Competencies for Medical Students: A Scoping Review on Frameworks, Programs, and Tools

Read original: arXiv:2407.18939 - Published 7/30/2024 by Yingbo Ma, Yukyeong Song, Jeremy A. Balch, Yuanfang Ren, Divya Vellanki, Zhenhong Hu, Meghan Brennan, Suraj Kolla, Ziyuan Guan, Brooke Armfield and 5 others
Total Score

0

🤖

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • As artificial intelligence (AI) becomes more common in healthcare, it's crucial for doctors to understand and use AI safely and ethically.
  • A review of 1,699 research papers found 18 studies proposing frameworks and 11 studies documenting real-world instruction for integrating AI into medical education.
  • The researchers found that current efforts focus more on AI evaluation and ethics rather than technical topics like data science and coding.
  • Challenges include a lack of guidelines for AI literacy, doubts about the clinical value of AI, and a shortage of qualified instructors.
  • The researchers propose an AI literacy framework with four dimensions: Foundational, Practical, Experimental, and Ethical.

Plain English Explanation

As artificial intelligence (AI) in healthcare becomes more common, it's important for doctors to understand how to use it safely and ethically. The researchers reviewed nearly 1,700 research papers and found that while there are some efforts to teach AI in medical schools, the focus is often on evaluating AI and discussing the ethics, rather than the technical details like data science and coding.

The researchers identified several challenges with integrating AI training into medical education. There aren't clear guidelines for what level of "AI literacy" medical students should have. Some people also doubt whether AI will provide enough clinical value to justify the time spent teaching it. And there's a shortage of qualified instructors who can teach AI effectively.

To address these issues, the researchers propose a framework for AI education in medical schools. They break down AI literacy into four key areas: Foundational knowledge, Practical application, Experimental skills, and Ethical considerations. By tailoring the learning objectives to different stages of medical education, the researchers hope to provide a roadmap for developing practical and relevant AI training for future doctors.

Technical Explanation

The researchers conducted a scoping review of 1,699 articles published between January 2016 and June 2024 to identify studies on integrating AI into medical education. They found 18 studies proposing guiding frameworks and 11 studies documenting real-world instruction.

The analysis revealed that current efforts tend to focus more on topics like AI evaluation and ethics, rather than technical subjects like data science and coding. The researchers identified several key challenges, including:

  1. Lack of guidelines to define AI literacy competencies for medical students
  2. Perceived lack of proven clinical value of AI
  3. Scarcity of qualified instructors to teach AI effectively

To address these gaps, the researchers propose an AI literacy framework with four dimensions:

  1. Foundational: Basic understanding of AI concepts and technologies
  2. Practical: Ability to apply AI tools and techniques in clinical practice
  3. Experimental: Skills to evaluate, validate, and interpret AI-based clinical solutions
  4. Ethical: Knowledge of ethical principles and guidelines for the responsible use of AI

The researchers suggest tailoring the learning objectives for each dimension to the pre-clinical, clinical, and clinical research stages of medical education. This approach aims to provide a roadmap for developing practical and relevant AI education strategies to build an AI-competent healthcare workforce.

Critical Analysis

The researchers acknowledge that the proposed AI literacy framework may require greater clinical relevance and personalization to suit the diverse interests and career trajectories of medical students. They also note that current efforts tend to emphasize AI evaluation and ethics over technical topics, which may not adequately prepare students for the practical application of AI in clinical practice.

Additionally, the researchers highlight the challenge of a perceived lack of proven clinical value of AI, which could hinder the integration of AI education into already-crowded medical curricula. They suggest that further research is needed to demonstrate the tangible benefits of AI-enabled healthcare solutions to justify the investment in AI training for medical students.

The scarcity of qualified instructors capable of teaching AI effectively is another significant hurdle identified in the paper. Addressing this issue may require collaboration between medical schools, technology companies, and AI experts to develop training programs and resources for faculty.

Conclusion

As AI increasingly becomes a part of clinical workflows, this review highlights the critical need to integrate AI literacy into medical education. By proposing a comprehensive framework that spans foundational knowledge, practical application, experimental skills, and ethical considerations, the researchers provide a roadmap for developing effective AI training strategies for future healthcare providers. Addressing the identified challenges and ensuring that AI education is relevant, personalized, and clinically meaningful will be crucial for building an AI-competent healthcare workforce capable of delivering safe and ethical patient care.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🤖

Total Score

0

Promoting AI Competencies for Medical Students: A Scoping Review on Frameworks, Programs, and Tools

Yingbo Ma, Yukyeong Song, Jeremy A. Balch, Yuanfang Ren, Divya Vellanki, Zhenhong Hu, Meghan Brennan, Suraj Kolla, Ziyuan Guan, Brooke Armfield, Tezcan Ozrazgat-Baslanti, Parisa Rashidi, Tyler J. Loftus, Azra Bihorac, Benjamin Shickel

As more clinical workflows continue to be augmented by artificial intelligence (AI), AI literacy among physicians will become a critical requirement for ensuring safe and ethical AI-enabled patient care. Despite the evolving importance of AI in healthcare, the extent to which it has been adopted into traditional and often-overloaded medical curricula is currently unknown. In a scoping review of 1,699 articles published between January 2016 and June 2024, we identified 18 studies which propose guiding frameworks, and 11 studies documenting real-world instruction, centered around the integration of AI into medical education. We found that comprehensive guidelines will require greater clinical relevance and personalization to suit medical student interests and career trajectories. Current efforts highlight discrepancies in the teaching guidelines, emphasizing AI evaluation and ethics over technical topics such as data science and coding. Additionally, we identified several challenges associated with integrating AI training into the medical education program, including a lack of guidelines to define medical students AI literacy, a perceived lack of proven clinical value, and a scarcity of qualified instructors. With this knowledge, we propose an AI literacy framework to define competencies for medical students. To prioritize relevant and personalized AI education, we categorize literacy into four dimensions: Foundational, Practical, Experimental, and Ethical, with tailored learning objectives to the pre-clinical, clinical, and clinical research stages of medical education. This review provides a road map for developing practical and relevant education strategies for building an AI-competent healthcare workforce.

Read more

7/30/2024

Designing for Complementarity: A Conceptual Framework to Go Beyond the Current Paradigm of Using XAI in Healthcare
Total Score

0

Designing for Complementarity: A Conceptual Framework to Go Beyond the Current Paradigm of Using XAI in Healthcare

Elisa Rubegni, Omran Ayoub, Stefania Maria Rita Rizzo, Marco Barbero, Guenda Bernegger, Francesca Faraci, Francesca Mangili, Emiliano Soldini, Pierpaolo Trimboli, Alessandro Facchini

The widespread use of Artificial Intelligence-based tools in the healthcare sector raises many ethical and legal problems, one of the main reasons being their black-box nature and therefore the seemingly opacity and inscrutability of their characteristics and decision-making process. Literature extensively discusses how this can lead to phenomena of over-reliance and under-reliance, ultimately limiting the adoption of AI. We addressed these issues by building a theoretical framework based on three concepts: Feature Importance, Counterexample Explanations, and Similar-Case Explanations. Grounded in the literature, the model was deployed within a case study in which, using a participatory design approach, we designed and developed a high-fidelity prototype. Through the co-design and development of the prototype and the underlying model, we advanced the knowledge on how to design AI-based systems for enabling complementarity in the decision-making process in the healthcare domain. Our work aims at contributing to the current discourse on designing AI systems to support clinicians' decision-making processes.

Read more

4/9/2024

🚀

Total Score

0

FUTURE-AI: International consensus guideline for trustworthy and deployable artificial intelligence in healthcare

Karim Lekadir, Aasa Feragen, Abdul Joseph Fofanah, Alejandro F Frangi, Alena Buyx, Anais Emelie, Andrea Lara, Antonio R Porras, An-Wen Chan, Arcadi Navarro, Ben Glocker, Benard O Botwe, Bishesh Khanal, Brigit Beger, Carol C Wu, Celia Cintas, Curtis P Langlotz, Daniel Rueckert, Deogratias Mzurikwao, Dimitrios I Fotiadis, Doszhan Zhussupov, Enzo Ferrante, Erik Meijering, Eva Weicken, Fabio A Gonz'alez, Folkert W Asselbergs, Fred Prior, Gabriel P Krestin, Gary Collins, Geletaw S Tegenaw, Georgios Kaissis, Gianluca Misuraca, Gianna Tsakou, Girish Dwivedi, Haridimos Kondylakis, Harsha Jayakody, Henry C Woodruf, Horst Joachim Mayer, Hugo JWL Aerts, Ian Walsh, Ioanna Chouvarda, Ir`ene Buvat, Isabell Tributsch, Islem Rekik, James Duncan, Jayashree Kalpathy-Cramer, Jihad Zahir, Jinah Park, John Mongan, Judy W Gichoya, Julia A Schnabel, Kaisar Kushibar, Katrine Riklund, Kensaku Mori, Kostas Marias, Lameck M Amugongo, Lauren A Fromont, Lena Maier-Hein, Leonor Cerd'a Alberich, Leticia Rittner, Lighton Phiri, Linda Marrakchi-Kacem, Llu'is Donoso-Bach, Luis Mart'i-Bonmat'i, M Jorge Cardoso, Maciej Bobowicz, Mahsa Shabani, Manolis Tsiknakis, Maria A Zuluaga, Maria Bielikova, Marie-Christine Fritzsche, Marina Camacho, Marius George Linguraru, Markus Wenzel, Marleen De Bruijne, Martin G Tolsgaard, Marzyeh Ghassemi, Md Ashrafuzzaman, Melanie Goisauf, Mohammad Yaqub, M'onica Cano Abad'ia, Mukhtar M E Mahmoud, Mustafa Elattar, Nicola Rieke, Nikolaos Papanikolaou, Noussair Lazrak, Oliver D'iaz, Olivier Salvado, Oriol Pujol, Ousmane Sall, Pamela Guevara, Peter Gordebeke, Philippe Lambin, Pieta Brown, Purang Abolmaesumi, Qi Dou, Qinghua Lu, Richard Osuala, Rose Nakasi, S Kevin Zhou, Sandy Napel, Sara Colantonio, Shadi Albarqouni, Smriti Joshi, Stacy Carter, Stefan Klein, Steffen E Petersen, Susanna Auss'o, Suyash Awate, Tammy Riklin Raviv, Tessa Cook, Tinashe E M Mutsvangwa, Wendy A Rogers, Wiro J Niessen, X`enia Puig-Bosch, Yi Zeng, Yunusa G Mohammed, Yves Saint James Aquino, Zohaib Salahuddin, Martijn P A Starmans

Despite major advances in artificial intelligence (AI) for medicine and healthcare, the deployment and adoption of AI technologies remain limited in real-world clinical practice. In recent years, concerns have been raised about the technical, clinical, ethical and legal risks associated with medical AI. To increase real world adoption, it is essential that medical AI tools are trusted and accepted by patients, clinicians, health organisations and authorities. This work describes the FUTURE-AI guideline as the first international consensus framework for guiding the development and deployment of trustworthy AI tools in healthcare. The FUTURE-AI consortium was founded in 2021 and currently comprises 118 inter-disciplinary experts from 51 countries representing all continents, including AI scientists, clinicians, ethicists, and social scientists. Over a two-year period, the consortium defined guiding principles and best practices for trustworthy AI through an iterative process comprising an in-depth literature review, a modified Delphi survey, and online consensus meetings. The FUTURE-AI framework was established based on 6 guiding principles for trustworthy AI in healthcare, i.e. Fairness, Universality, Traceability, Usability, Robustness and Explainability. Through consensus, a set of 28 best practices were defined, addressing technical, clinical, legal and socio-ethical dimensions. The recommendations cover the entire lifecycle of medical AI, from design, development and validation to regulation, deployment, and monitoring. FUTURE-AI is a risk-informed, assumption-free guideline which provides a structured approach for constructing medical AI tools that will be trusted, deployed and adopted in real-world practice. Researchers are encouraged to take the recommendations into account in proof-of-concept stages to facilitate future translation towards clinical practice of medical AI.

Read more

7/9/2024

🤖

Total Score

0

New!AI Literacy for All: Adjustable Interdisciplinary Socio-technical Curriculum

Sri Yash Tadimalla, Mary Lou Maher

This paper presents a curriculum, AI Literacy for All, to promote an interdisciplinary understanding of AI, its socio-technical implications, and its practical applications for all levels of education. With the rapid evolution of artificial intelligence (AI), there is a need for AI literacy that goes beyond the traditional AI education curriculum. AI literacy has been conceptualized in various ways, including public literacy, competency building for designers, conceptual understanding of AI concepts, and domain-specific upskilling. Most of these conceptualizations were established before the public release of Generative AI (Gen-AI) tools like ChatGPT. AI education has focused on the principles and applications of AI through a technical lens that emphasizes the mastery of AI principles, the mathematical foundations underlying these technologies, and the programming and mathematical skills necessary to implement AI solutions. In AI Literacy for All, we emphasize a balanced curriculum that includes technical and non-technical learning outcomes to enable a conceptual understanding and critical evaluation of AI technologies in an interdisciplinary socio-technical context. The paper presents four pillars of AI literacy: understanding the scope and technical dimensions of AI, learning how to interact with Gen-AI in an informed and responsible way, the socio-technical issues of ethical and responsible AI, and the social and future implications of AI. While it is important to include all learning outcomes for AI education in a Computer Science major, the learning outcomes can be adjusted for other learning contexts, including, non-CS majors, high school summer camps, the adult workforce, and the public. This paper advocates for a shift in AI literacy education to offer a more interdisciplinary socio-technical approach as a pathway to broaden participation in AI.

Read more

9/18/2024