CT-ADE: An Evaluation Benchmark for Adverse Drug Event Prediction from Clinical Trial Results
0
🔮
Sign in to get full access
Overview
- The paper introduces a new dataset called CT-ADE, which aims to enhance the predictive modeling of adverse drug events (ADEs) in clinical trials.
- ADEs can significantly impact clinical research and public health, leading to failures in clinical trials and increased healthcare costs. Accurate prediction and management of ADEs are crucial for developing safer and more effective medications.
- The CT-ADE dataset integrates drug, patient population, and contextual information for multi-label ADE classification tasks in monopharmacy treatments, providing a comprehensive resource for developing advanced predictive models.
Plain English Explanation
The paper discusses a new dataset called CT-ADE that was created to help predict and manage adverse drug events (ADEs). ADEs are problems that can occur when people take medications, and they can have a big impact on clinical research and public health. For example, ADEs can cause clinical trials to fail and increase healthcare costs.
To address this issue, the CT-ADE dataset was compiled with information about drugs, patients, and the context of ADEs. This data can be used to train machine learning models to better predict and manage ADEs, which could lead to the development of safer and more effective medications.
The dataset contains over 12,000 examples of ADEs, with annotations that follow a standard medical terminology called MedDRA. Initial tests using baseline models have shown promising results, achieving high accuracy in classifying the types of ADEs. This suggests the CT-ADE dataset could be a valuable tool for researchers using artificial intelligence and machine learning to improve patient safety and minimize the impact of ADEs on pharmaceutical research and development.
Technical Explanation
The CT-ADE dataset was created to enhance the predictive modeling of adverse drug events (ADEs) in clinical trials. The dataset integrates drug, patient population, and contextual information for multi-label ADE classification tasks in monopharmacy treatments. This comprehensive data resource aims to support the development of advanced predictive models to improve the safety and effectiveness of new medications.
The dataset contains over 12,000 instances of ADEs extracted from clinical trial results. To mirror the complex nature of ADEs, the annotations are standardized at the system organ class level of the Medical Dictionary for Regulatory Activities (MedDRA) ontology. Preliminary analyses using baseline models have demonstrated promising results, achieving a 73.33% F1 score and 81.54% balanced accuracy, highlighting the potential of the CT-ADE dataset to advance ADE prediction.
Critical Analysis
The paper provides a valuable contribution to the field of ADE prediction by introducing the CT-ADE dataset, which addresses the need for comprehensive data to support the development of advanced predictive models. The authors have taken steps to ensure the dataset mirrors the complex nature of ADEs through the use of standardized MedDRA annotations.
However, the paper does not delve deeply into the specific challenges or limitations encountered in compiling the dataset. Additionally, the baseline model results, while promising, do not provide a comprehensive evaluation of the dataset's utility. Further research is needed to assess the performance of more advanced machine learning and AI models on the CT-ADE dataset and to explore its potential applications in real-world clinical settings.
Conclusion
The CT-ADE dataset represents a significant step forward in the effort to improve the prediction and management of adverse drug events. By providing a comprehensive data resource that integrates drug, patient, and contextual information, the dataset has the potential to catalyze the development of advanced predictive models that can enhance patient safety and minimize the impact of ADEs on pharmaceutical research and development. As the field of AI-powered healthcare continues to evolve, tools like CT-ADE will be crucial in unlocking the full potential of these technologies to deliver safer and more effective medications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🔮
0
CT-ADE: An Evaluation Benchmark for Adverse Drug Event Prediction from Clinical Trial Results
Anthony Yazdani, Alban Bornet, Philipp Khlebnikov, Boya Zhang, Hossein Rouhizadeh, Poorya Amini, Douglas Teodoro
Adverse drug events (ADEs) significantly impact clinical research, causing many clinical trial failures. ADE prediction is key for developing safer medications and enhancing patient outcomes. To support this effort, we introduce CT-ADE, a dataset for multilabel predictive modeling of ADEs in monopharmacy treatments. CT-ADE integrates data from 2,497 unique drugs, encompassing 168,984 drug-ADE pairs extracted from clinical trials, annotated with patient and contextual information, and comprehensive ADE concepts standardized across multiple levels of the MedDRA ontology. Preliminary analyses with large language models (LLMs) achieved F1-scores up to 55.90%. Models using patient and contextual information showed F1-score improvements of 21%-38% over models using only chemical structure data. Our results highlight the importance of target population and treatment regimens in the predictive modeling of ADEs, offering greater performance gains than LLM domain specialization and scaling. CT-ADE provides an essential tool for researchers aiming to leverage artificial intelligence and machine learning to enhance patient safety and minimize the impact of ADEs on pharmaceutical research and development. The dataset is publicly accessible at https://github.com/ds4dh/CT-ADE.
Read more7/31/2024
0
MultiADE: A Multi-domain Benchmark for Adverse Drug Event Extraction
Xiang Dai, Sarvnaz Karimi, Abeed Sarker, Ben Hachey, Cecile Paris
Objective. Active adverse event surveillance monitors Adverse Drug Events (ADE) from different data sources, such as electronic health records, medical literature, social media and search engine logs. Over years, many datasets are created, and shared tasks are organised to facilitate active adverse event surveillance. However, most-if not all-datasets or shared tasks focus on extracting ADEs from a particular type of text. Domain generalisation-the ability of a machine learning model to perform well on new, unseen domains (text types)-is under-explored. Given the rapid advancements in natural language processing, one unanswered question is how far we are from having a single ADE extraction model that are effective on various types of text, such as scientific literature and social media posts}. Methods. We contribute to answering this question by building a multi-domain benchmark for adverse drug event extraction, which we named MultiADE. The new benchmark comprises several existing datasets sampled from different text types and our newly created dataset-CADECv2, which is an extension of CADEC (Karimi, et al., 2015), covering online posts regarding more diverse drugs than CADEC. Our new dataset is carefully annotated by human annotators following detailed annotation guidelines. Conclusion. Our benchmark results show that the generalisation of the trained models is far from perfect, making it infeasible to be deployed to process different types of text. In addition, although intermediate transfer learning is a promising approach to utilising existing resources, further investigation is needed on methods of domain adaptation, particularly cost-effective methods to select useful training instances.
Read more5/29/2024
0
Enhancing Adverse Drug Event Detection with Multimodal Dataset: Corpus Creation and Model Development
Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Aman Chadha, Samrat Mondal
The mining of adverse drug events (ADEs) is pivotal in pharmacovigilance, enhancing patient safety by identifying potential risks associated with medications, facilitating early detection of adverse events, and guiding regulatory decision-making. Traditional ADE detection methods are reliable but slow, not easily adaptable to large-scale operations, and offer limited information. With the exponential increase in data sources like social media content, biomedical literature, and Electronic Medical Records (EMR), extracting relevant ADE-related information from these unstructured texts is imperative. Previous ADE mining studies have focused on text-based methodologies, overlooking visual cues, limiting contextual comprehension, and hindering accurate interpretation. To address this gap, we present a MultiModal Adverse Drug Event (MMADE) detection dataset, merging ADE-related textual information with visual aids. Additionally, we introduce a framework that leverages the capabilities of LLMs and VLMs for ADE detection by generating detailed descriptions of medical images depicting ADEs, aiding healthcare professionals in visually identifying adverse events. Using our MMADE dataset, we showcase the significance of integrating visual cues from images to enhance overall performance. This approach holds promise for patient safety, ADE awareness, and healthcare accessibility, paving the way for further exploration in personalized healthcare.
Read more5/28/2024
🧠
0
Knowledge-augmented Graph Neural Networks with Concept-aware Attention for Adverse Drug Event Detection
Shaoxiong Ji, Ya Gao, Pekka Marttinen
Adverse drug events (ADEs) are an important aspect of drug safety. Various texts such as biomedical literature, drug reviews, and user posts on social media and medical forums contain a wealth of information about ADEs. Recent studies have applied word embedding and deep learning -based natural language processing to automate ADE detection from text. However, they did not explore incorporating explicit medical knowledge about drugs and adverse reactions or the corresponding feature learning. This paper adopts the heterogenous text graph which describes relationships between documents, words and concepts, augments it with medical knowledge from the Unified Medical Language System, and proposes a concept-aware attention mechanism which learns features differently for the different types of nodes in the graph. We further utilize contextualized embeddings from pretrained language models and convolutional graph neural networks for effective feature representation and relational learning. Experiments on four public datasets show that our model achieves performance competitive to the recent advances and the concept-aware attention consistently outperforms other attention mechanisms.
Read more5/21/2024