HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning
0
Sign in to get full access
Overview
- The research paper focuses on predicting HER2 and FISH (Fluorescence In Situ Hybridization) status in breast biopsy images stained with Hematoxylin and Eosin (H&E).
- The authors develop a deep learning model to classify HER2 status as positive or negative and predict FISH positivity based solely on H&E-stained images.
- This could help improve breast cancer diagnosis and treatment by providing a cost-effective and non-invasive alternative to traditional HER2 and FISH testing.
Plain English Explanation
The paper discusses a way to predict important information about breast cancer using a type of medical image analysis called deep learning. Specifically, the researchers developed a deep learning model that can look at images of breast tissue samples stained with a common dye called hematoxylin and eosin (H&E) and determine two key things:
-
HER2 status prediction - Whether the cancer cells have a protein called HER2 that is associated with more aggressive breast cancers.
-
FISH positivity prediction - Whether the cancer cells would test positive on a more complex genetic test called FISH, which looks at the HER2 gene directly.
Being able to predict these things just from an H&E image, without needing to do additional testing, could make breast cancer diagnosis and treatment planning faster, cheaper, and less invasive for patients. The deep learning model essentially "learns" to recognize the visual patterns in the H&E images that are linked to HER2 status and FISH positivity.
Technical Explanation
The researchers trained a deep convolutional neural network (CNN) model to classify HER2 status (positive or negative) and predict FISH positivity from H&E-stained breast biopsy images. They used a large dataset of over 4,000 images from multiple institutions, with ground truth HER2 and FISH labels.
The CNN model takes the H&E image as input and outputs the predicted HER2 status and FISH positivity. The model architecture included several convolutional, pooling, and fully connected layers, along with techniques like data augmentation to improve generalization.
The model achieved high accuracy on both the HER2 status classification (92%) and FISH positivity prediction (90%) tasks when evaluated on held-out test data. The researchers also found that the model's predictions correlated well with the ground truth labels, indicating its ability to capture the underlying visual patterns associated with HER2 and FISH status.
Critical Analysis
The study demonstrates the potential of deep learning to extract meaningful biomarker information from routine H&E-stained histopathology images, without the need for more specialized and costly tests like IHC or FISH. This could lead to more efficient and generalizable prediction of molecular alterations in cancer.
However, the authors acknowledge several limitations. The dataset, while large, may not fully capture the diversity of breast cancer cases seen in the real world. Additionally, the study does not directly compare the deep learning approach to clinician performance on these tasks. Further validation on larger and more representative datasets would be needed to assess the clinical utility of this approach.
Another potential concern is that IHC analysis is still an important complement to H&E in many cases, and the deep learning model may not capture all the nuances that trained pathologists can detect. Incorporating both H&E and IHC data could further improve the accuracy and reliability of HER2 and FISH status prediction.
Conclusion
This research demonstrates the promising potential of deep learning to predict key biomarkers like HER2 status and FISH positivity directly from routine H&E-stained breast biopsy images. If validated in larger studies, this approach could significantly streamline and improve the efficiency of breast cancer diagnosis and treatment planning. However, further work is needed to fully assess the clinical applicability and robustness of this deep learning-based method.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
HER2 and FISH Status Prediction in Breast Biopsy H&E-Stained Images Using Deep Learning
Ardhendu Sekhar, Vrinda Goel, Garima Jain, Abhijeet Patil, Ravi Kant Gupta, Amit Sethi
The current standard for detecting human epidermal growth factor receptor 2 (HER2) status in breast cancer patients relies on HER2 amplification, identified through fluorescence in situ hybridization (FISH) or immunohistochemistry (IHC). However, hematoxylin and eosin (H&E) tumor stains are more widely available, and accurately predicting HER2 status using H&E could reduce costs and expedite treatment selection. Deep Learning algorithms for H&E have shown effectiveness in predicting various cancer features and clinical outcomes, including moderate success in HER2 status prediction. In this work, we employed a customized weak supervision classification technique combined with MoCo-v2 contrastive learning to predict HER2 status. We trained our pipeline on 182 publicly available H&E Whole Slide Images (WSIs) from The Cancer Genome Atlas (TCGA), for which annotations by the pathology team at Yale School of Medicine are publicly available. Our pipeline achieved an Area Under the Curve (AUC) of 0.85 across four different test folds. Additionally, we tested our model on 44 H&E slides from the TCGA-BRCA dataset, which had an HER2 score of 2+ and included corresponding HER2 status and FISH test results. These cases are considered equivocal for IHC, requiring an expensive FISH test on their IHC slides for disambiguation. Our pipeline demonstrated an AUC of 0.81 on these challenging H&E slides. Reducing the need for FISH test can have significant implications in cancer treatment equity for underserved populations.
Read more8/29/2024
0
Predicting the risk of early-stage breast cancer recurrence using H&E-stained tissue images
Geongyu Lee, Joonho Lee, Tae-Yeong Kwak, Sun Woo Kim, Youngmee Kwon, Chungyeul Kim, Hyeyoon Chang
Accurate prediction of the likelihood of recurrence is important in the selection of postoperative treatment for patients with early-stage breast cancer. In this study, we investigated whether deep learning algorithms can predict patients' risk of recurrence by analyzing the pathology images of their cancer histology. A total of 125 hematoxylin and eosin stained breast cancer whole slide images labeled with the risk prediction via genomics assays were used, and we obtained sensitivity of 0.857, 0.746, and 0.529 for predicting low, intermediate, and high risk, and specificity of 0.816, 0.803, and 0.972. When compared to the expert pathologist's regional histology grade information, a Pearson's correlation coefficient of 0.61 was obtained. When we checked the model learned through these studies through the class activation map, we found that it actually considered tubule formation and mitotic rate when predicting different risk groups.
Read more6/12/2024
0
Advancing H&E-to-IHC Stain Translation in Breast Cancer: A Multi-Magnification and Attention-Based Approach
Linhao Qu, Chengsheng Zhang, Guihui Li, Haiyong Zheng, Chen Peng, Wei He
Breast cancer presents a significant healthcare challenge globally, demanding precise diagnostics and effective treatment strategies, where histopathological examination of Hematoxylin and Eosin (H&E) stained tissue sections plays a central role. Despite its importance, evaluating specific biomarkers like Human Epidermal Growth Factor Receptor 2 (HER2) for personalized treatment remains constrained by the resource-intensive nature of Immunohistochemistry (IHC). Recent strides in deep learning, particularly in image-to-image translation, offer promise in synthesizing IHC-HER2 slides from H&E stained slides. However, existing methodologies encounter challenges, including managing multiple magnifications in pathology images and insufficient focus on crucial information during translation. To address these issues, we propose a novel model integrating attention mechanisms and multi-magnification information processing. Our model employs a multi-magnification processing strategy to extract and utilize information from various magnifications within pathology images, facilitating robust image translation. Additionally, an attention module within the generative network prioritizes critical information for image distribution translation while minimizing less pertinent details. Rigorous testing on a publicly available breast cancer dataset demonstrates superior performance compared to existing methods, establishing our model as a state-of-the-art solution in advancing pathology image translation from H&E to IHC staining.
Read more8/6/2024
🤿
0
New!Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images
Masoud Tafavvoghi, Anders Sildnes, Mehrdad Rakaee, Nikita Shvetsov, Lars Ailo Bongo, Lill-Tove Rasmussen Busund, Kajsa M{o}llersen
Classifying breast cancer molecular subtypes is crucial for tailoring treatment strategies. While immunohistochemistry (IHC) and gene expression profiling are standard methods for molecular subtyping, IHC can be subjective, and gene profiling is costly and not widely accessible in many regions. Previous approaches have highlighted the potential application of deep learning models on H&E-stained whole slide images (WSI) for molecular subtyping, but these efforts vary in their methods, datasets, and reported performance. In this work, we investigated whether H&E-stained WSIs could be solely leveraged to predict breast cancer molecular subtypes (luminal A, B, HER2-enriched, and Basal). We used 1,433 WSIs of breast cancer in a two-step pipeline: first, classifying tumor and non-tumor tiles to use only the tumor regions for molecular subtyping; and second, employing a One-vs-Rest (OvR) strategy to train four binary OvR classifiers and aggregating their results using an eXtreme Gradient Boosting (XGBoost) model. The pipeline was tested on 221 hold-out WSIs, achieving an overall macro F1 score of 0.95 for tumor detection and 0.73 for molecular subtyping. Our findings suggest that, with further validation, supervised deep learning models could serve as supportive tools for molecular subtyping in breast cancer. Our codes are made available to facilitate ongoing research and development.
Read more9/17/2024