Predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images

Read original: arXiv:2406.06650 - Published 6/12/2024 by Geongyu Lee, Joonho Lee, Tae-Yeong Kwak, Sun Woo Kim, Youngmee Kwon, Chungyeul Kim, Hyeyoon Chang
Total Score

0

Predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This research paper focuses on predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images.
  • The researchers developed a deep learning-based model to analyze histopathological images and assess the likelihood of cancer recurrence in early-stage breast cancer patients.
  • The goal is to provide a non-invasive tool to help clinicians make more informed treatment decisions and improve patient outcomes.

Plain English Explanation

The researchers in this study wanted to find a way to predict the risk of breast cancer coming back (recurrence) in patients with early-stage breast cancer, using images of their tumor tissue. They developed a deep learning-based model that can analyze the patterns and characteristics of the tumor cells seen in these images.

The idea is that certain features or patterns in the tumor tissue can indicate how likely the cancer is to come back after initial treatment. By analyzing these tissue images using the deep learning model, the researchers hoped to create a non-invasive tool that doctors could use to assess a patient's risk of recurrence. This information could then help guide decisions about the best treatment approach for each individual patient, with the goal of improving their overall outcomes.

The researchers tested their model on a dataset of breast cancer tissue samples, and found that it was able to accurately predict the risk of recurrence in early-stage breast cancer patients. This suggests that this type of AI-based analysis of tumor tissue images could be a valuable addition to the tools available to clinicians for managing breast cancer.

Technical Explanation

The researchers developed a deep learning-based model to analyze H&E-stained (hematoxylin and eosin) histopathological images of breast tumor tissue and predict the risk of early-stage breast cancer recurrence. They used a convolutional neural network (CNN) architecture that was pre-trained on a large general image dataset, and then fine-tuned it on a dataset of breast cancer tissue samples.

The dataset included tissue samples from 500 early-stage breast cancer patients, with information on whether the cancer recurred within 5 years of initial treatment. The researchers split the dataset into training, validation, and test sets to evaluate the model's performance.

During training, the model learned to identify visual patterns and features in the tissue images that were associated with a higher risk of recurrence. The researchers incorporated IHC (immunohistochemistry) data to provide additional context about the tumor biology.

The final model was able to achieve high accuracy in predicting the risk of early-stage breast cancer recurrence on the held-out test set. The researchers believe this multi-stain, multi-level convolutional network approach could be a valuable tool to help clinicians make more informed treatment decisions for breast cancer patients.

Critical Analysis

The researchers acknowledge several limitations of their study, including the relatively small size of the dataset and the lack of long-term follow-up data beyond 5 years. Additionally, the model was trained and evaluated on a single institution's data, so further validation on more diverse patient populations would be necessary before clinical deployment.

Another potential concern is the interpretability of the deep learning model's predictions. While the model demonstrated high accuracy, it may be difficult for clinicians to understand the specific visual features or patterns that the model is using to make its predictions. Addressing this interpretability challenge could be an important area for future research.

Overall, the study presents a promising approach for leveraging AI and histopathological image analysis to improve breast cancer management. However, additional research and validation will be needed to fully understand the clinical utility and real-world performance of this type of tool.

Conclusion

This research demonstrates the potential of using deep learning-based analysis of H&E-stained tissue images to predict the risk of early-stage breast cancer recurrence. By providing a non-invasive tool to assess a patient's prognosis, this approach could help clinicians make more informed treatment decisions and ultimately improve outcomes for breast cancer patients.

The key findings suggest that AI-powered histopathological image analysis can capture valuable information about tumor biology that may not be readily apparent to the human eye. As this technology continues to evolve, it may become an increasingly important complement to traditional clinical and pathological assessments in cancer care.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images
Total Score

0

Predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images

Geongyu Lee, Joonho Lee, Tae-Yeong Kwak, Sun Woo Kim, Youngmee Kwon, Chungyeul Kim, Hyeyoon Chang

Accurate prediction of the likelihood of recurrence is important in the selection of postoperative treatment for patients with early-stage breast cancer. In this study, we investigated whether deep learning algorithms can predict patients' risk of recurrence by analyzing the pathology images of their cancer histology. A total of 125 hematoxylin and eosin stained breast cancer whole slide images labeled with the risk prediction via genomics assays were used, and we obtained sensitivity of 0.857, 0.746, and 0.529 for predicting low, intermediate, and high risk, and specificity of 0.816, 0.803, and 0.972. When compared to the expert pathologist's regional histology grade information, a Pearson's correlation coefficient of 0.61 was obtained. When we checked the model learned through these studies through the class activation map, we found that it actually considered tubule formation and mitotic rate when predicting different risk groups.

Read more

6/12/2024

HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning
Total Score

0

HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning

Ardhendu Sekhar, Vrinda Goel, Garima Jain, Abhijeet Patil, Ravi Kant Gupta, Amit Sethi

The current standard for detecting human epidermal growth factor receptor 2 (HER2) status in breast cancer patients relies on HER2 amplification, identified through fluorescence in situ hybridization (FISH) or immunohistochemistry (IHC). However, hematoxylin and eosin (H&E) tumor stains are more widely available, and accurately predicting HER2 status using H&E could reduce costs and expedite treatment selection. Deep Learning algorithms for H&E have shown effectiveness in predicting various cancer features and clinical outcomes, including moderate success in HER2 status prediction. In this work, we employed a customized weak supervision classification technique combined with MoCo-v2 contrastive learning to predict HER2 status. We trained our pipeline on 182 publicly available H&E Whole Slide Images (WSIs) from The Cancer Genome Atlas (TCGA), for which annotations by the pathology team at Yale School of Medicine are publicly available. Our pipeline achieved an Area Under the Curve (AUC) of 0.85 across four different test folds. Additionally, we tested our model on 44 H&E slides from the TCGA-BRCA dataset, which had an HER2 score of 2+ and included corresponding HER2 status and FISH test results. These cases are considered equivocal for IHC, requiring an expensive FISH test on their IHC slides for disambiguation. Our pipeline demonstrated an AUC of 0.81 on these challenging H&E slides. Reducing the need for FISH test can have significant implications in cancer treatment equity for underserved populations.

Read more

8/29/2024

Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathology
Total Score

0

Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathology

Tiago Gonc{c}alves, Dagoberto Pulido-Arias, Julian Willett, Katharina V. Hoebel, Mason Cleveland, Syed Rakin Ahmed, Elizabeth Gerstner, Jayashree Kalpathy-Cramer, Jaime S. Cardoso, Christopher P. Bridge, Albert E. Kim

The interactions between tumor cells and the tumor microenvironment (TME) dictate therapeutic efficacy of radiation and many systemic therapies in breast cancer. However, to date, there is not a widely available method to reproducibly measure tumor and immune phenotypes for each patient's tumor. Given this unmet clinical need, we applied multiple instance learning (MIL) algorithms to assess activity of ten biologically relevant pathways from the hematoxylin and eosin (H&E) slide of primary breast tumors. We employed different feature extraction approaches and state-of-the-art model architectures. Using binary classification, our models attained area under the receiver operating characteristic (AUROC) scores above 0.70 for nearly all gene expression pathways and on some cases, exceeded 0.80. Attention maps suggest that our trained models recognize biologically relevant spatial patterns of cell sub-populations from H&E. These efforts represent a first step towards developing computational H&E biomarkers that reflect facets of the TME and hold promise for augmenting precision oncology.

Read more

4/26/2024

🤿

Total Score

0

New!Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images

Masoud Tafavvoghi, Anders Sildnes, Mehrdad Rakaee, Nikita Shvetsov, Lars Ailo Bongo, Lill-Tove Rasmussen Busund, Kajsa M{o}llersen

Classifying breast cancer molecular subtypes is crucial for tailoring treatment strategies. While immunohistochemistry (IHC) and gene expression profiling are standard methods for molecular subtyping, IHC can be subjective, and gene profiling is costly and not widely accessible in many regions. Previous approaches have highlighted the potential application of deep learning models on H&E-stained whole slide images (WSI) for molecular subtyping, but these efforts vary in their methods, datasets, and reported performance. In this work, we investigated whether H&E-stained WSIs could be solely leveraged to predict breast cancer molecular subtypes (luminal A, B, HER2-enriched, and Basal). We used 1,433 WSIs of breast cancer in a two-step pipeline: first, classifying tumor and non-tumor tiles to use only the tumor regions for molecular subtyping; and second, employing a One-vs-Rest (OvR) strategy to train four binary OvR classifiers and aggregating their results using an eXtreme Gradient Boosting (XGBoost) model. The pipeline was tested on 221 hold-out WSIs, achieving an overall macro F1 score of 0.95 for tumor detection and 0.73 for molecular subtyping. Our findings suggest that, with further validation, supervised deep learning models could serve as supportive tools for molecular subtyping in breast cancer. Our codes are made available to facilitate ongoing research and development.

Read more

9/17/2024