High-Throughput Phenotyping of Clinical Text Using Large Language Models

Read original: arXiv:2408.01214 - Published 8/6/2024 by Daniel B. Hier, S. Ilyas Munzir, Anne Stahlfeld, Tayo Obafemi-Ajayi, Michael D. Carrithers
Total Score

0

High-Throughput Phenotyping of Clinical Text Using Large Language Models

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper explores the use of large language models (LLMs) for high-throughput phenotyping of clinical text.
  • Phenotyping involves extracting structured information from unstructured clinical notes to identify patient characteristics and conditions.
  • The researchers demonstrate that LLMs can effectively perform phenotyping tasks, outperforming traditional computational approaches.

Plain English Explanation

Large language models (LLMs) are powerful AI systems that can understand and generate human-like text. In this research, the authors show how LLMs can be used to extract key information from clinical notes - a process called "phenotyping."

Phenotyping is important for identifying patient characteristics and conditions based on their medical records. This information can help with diagnosing diseases, matching patients to clinical trials, and improving healthcare overall.

The researchers found that LLMs can perform phenotyping tasks much more efficiently and accurately than traditional computational approaches. This suggests that LLMs could be a powerful tool for rapidly extracting valuable insights from vast amounts of clinical data.

Technical Explanation

The paper demonstrates the use of large language models (LLMs) for high-throughput phenotyping of clinical text. Phenotyping involves extracting structured information from unstructured clinical notes to identify patient characteristics and conditions.

The researchers leveraged the GPT-4 LLM to perform phenotyping tasks on a dataset of clinical notes from the Online Mendelian Inheritance in Man (OMIM) database, which covers genetic disorders. The model was trained to identify phenotypes related to neurological conditions, as described in the Human Phenotype Ontology (HPO).

The LLM-based approach outperformed traditional computational methods, such as rule-based systems and supervised machine learning models, in terms of both speed and accuracy. The authors attribute this performance advantage to the LLM's ability to understand the nuanced and contextual language used in clinical notes.

Critical Analysis

The paper presents a compelling case for the use of LLMs in high-throughput phenotyping, but it also acknowledges several caveats and limitations.

One key concern is the potential for bias and inaccuracies in the LLM's outputs, particularly when dealing with rare or complex medical conditions. The researchers note that further validation and oversight would be necessary before deploying such a system in a real-world clinical setting.

Additionally, the study focused on a relatively narrow domain (neurological phenotypes from the HPO), and it remains to be seen how well the approach would generalize to a broader range of clinical specialties and phenotypes. Expanding the research to include more diverse datasets and use cases would be an important next step.

Conclusion

This research suggests that large language models have the potential to revolutionize the field of clinical phenotyping, enabling the rapid extraction of valuable insights from vast amounts of unstructured medical data. While further validation and development are needed, the findings demonstrate the power of LLMs to surpass traditional computational approaches in this critical domain.

The successful application of LLMs to high-throughput phenotyping could have far-reaching implications for healthcare, from improving disease diagnosis and matching patients to clinical trials, to developing personalized treatment plans and extracting valuable data for research and innovation.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

High-Throughput Phenotyping of Clinical Text Using Large Language Models
Total Score

0

High-Throughput Phenotyping of Clinical Text Using Large Language Models

Daniel B. Hier, S. Ilyas Munzir, Anne Stahlfeld, Tayo Obafemi-Ajayi, Michael D. Carrithers

High-throughput phenotyping automates the mapping of patient signs to standardized ontology concepts and is essential for precision medicine. This study evaluates the automation of phenotyping of clinical summaries from the Online Mendelian Inheritance in Man (OMIM) database using large language models. Due to their rich phenotype data, these summaries can be surrogates for physician notes. We conduct a performance comparison of GPT-4 and GPT-3.5-Turbo. Our results indicate that GPT-4 surpasses GPT-3.5-Turbo in identifying, categorizing, and normalizing signs, achieving concordance with manual annotators comparable to inter-rater agreement. Despite some limitations in sign normalization, the extensive pre-training of GPT-4 results in high performance and generalizability across several phenotyping tasks while obviating the need for manually annotated training data. Large language models are expected to be the dominant method for automating high-throughput phenotyping of clinical text.

Read more

8/6/2024

A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes
Total Score

0

A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notes

Syed I. Munzir, Daniel B. Hier, Chelsea Oommen, Michael D. Carrithers

High-throughput phenotyping, the automated mapping of patient signs and symptoms to standardized ontology concepts, is essential to gaining value from electronic health records (EHR) in the support of precision medicine. Despite technological advances, high-throughput phenotyping remains a challenge. This study compares three computational approaches to high-throughput phenotyping: a Large Language Model (LLM) incorporating generative AI, a Natural Language Processing (NLP) approach utilizing deep learning for span categorization, and a hybrid approach combining word vectors with machine learning. The approach that implemented GPT-4 (a Large Language Model) demonstrated superior performance, suggesting that Large Language Models are poised to be the preferred method for high-throughput phenotyping of physician notes.

Read more

6/24/2024

💬

Total Score

0

New!GP-GPT: Large Language Model for Gene-Phenotype Mapping

Yanjun Lyu, Zihao Wu, Lu Zhang, Jing Zhang, Yiwei Li, Wei Ruan, Zhengliang Liu, Xiaowei Yu, Chao Cao, Tong Chen, Minheng Chen, Yan Zhuang, Xiang Li, Rongjie Liu, Chao Huang, Wentao Li, Tianming Liu, Dajiang Zhu

Pre-trained large language models(LLMs) have attracted increasing attention in biomedical domains due to their success in natural language processing. However, the complex traits and heterogeneity of multi-sources genomics data pose significant challenges when adapting these models to the bioinformatics and biomedical field. To address these challenges, we present GP-GPT, the first specialized large language model for genetic-phenotype knowledge representation and genomics relation analysis. Our model is fine-tuned in two stages on a comprehensive corpus composed of over 3,000,000 terms in genomics, proteomics, and medical genetics, derived from multiple large-scale validated datasets and scientific publications. GP-GPT demonstrates proficiency in accurately retrieving medical genetics information and performing common genomics analysis tasks, such as genomics information retrieval and relationship determination. Comparative experiments across domain-specific tasks reveal that GP-GPT outperforms state-of-the-art LLMs, including Llama2, Llama3 and GPT-4. These results highlight GP-GPT's potential to enhance genetic disease relation research and facilitate accurate and efficient analysis in the fields of genomics and medical genetics. Our investigation demonstrated the subtle changes of bio-factor entities' representations in the GP-GPT, which suggested the opportunities for the application of LLMs to advancing gene-phenotype research.

Read more

9/17/2024

💬

Total Score

0

Matching Patients to Clinical Trials with Large Language Models

Qiao Jin, Zifeng Wang, Charalampos S. Floudas, Fangyuan Chen, Changlin Gong, Dara Bracken-Clarke, Elisabetta Xue, Yifan Yang, Jimeng Sun, Zhiyong Lu

Clinical trials are often hindered by the challenge of patient recruitment. In this work, we introduce TrialGPT, a first-of-its-kind large language model (LLM) framework to assist patient-to-trial matching. Given a patient note, TrialGPT predicts the patient's eligibility on a criterion-by-criterion basis and then consolidates these predictions to assess the patient's eligibility for the target trial. We evaluate the trial-level prediction performance of TrialGPT on three publicly available cohorts of 184 patients with over 18,000 trial annotations. We also engaged three physicians to label over 1,000 patient-criterion pairs to assess its criterion-level prediction accuracy. Experimental results show that TrialGPT achieves a criterion-level accuracy of 87.3% with faithful explanations, close to the expert performance (88.7%-90.0%). The aggregated TrialGPT scores are highly correlated with human eligibility judgments, and they outperform the best-competing models by 32.6% to 57.2% in ranking and excluding clinical trials. Furthermore, our user study reveals that TrialGPT can significantly reduce the screening time (by 42.6%) in a real-life clinical trial matching task. These results and analyses have demonstrated promising opportunities for clinical trial matching with LLMs such as TrialGPT.

Read more

4/30/2024