Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma
0
✅
Sign in to get full access
Overview
- Immunohistochemistry (IHC) analysis is a widely used method for molecular subtyping and prognosis of breast cancer.
- It involves assessing four key biomarkers: progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2).
- However, IHC scoring can be subjective and suffer from poor reproducibility, leading to incorrect results, especially for low-score cases.
Plain English Explanation
Breast cancer is the most common type of cancer affecting women. To determine the best treatment, doctors often look at certain molecules, or biomarkers, inside the tumor cells. This process is called immunohistochemistry (IHC) analysis. The key biomarkers they check are:
- Progesterone receptor (PR) - helps predict response to hormonal therapy
- Estrogen receptor (ER) - also helps predict response to hormonal therapy
- Antigen Ki67 - indicates how fast the cancer cells are growing
- Human epidermal growth factor receptor 2 (HER2) - helps determine if targeted therapies against HER2 may be effective
However, the way doctors currently score these biomarkers by looking at the tumor cells under a microscope can be quite subjective. This means different doctors may give different scores, even for the same tumor sample. This can lead to inaccurate results, especially for tumors with low levels of the biomarkers.
To address this issue, researchers have developed a deep learning-based system that can automatically analyze the tumor samples and provide objective, consistent scoring of the biomarkers. This system was trained on millions of annotated tumor cell images and can detect the tumor region, remove artifacts, and score the biomarkers according to standard guidelines.
In testing, this automated system achieved very high agreement with scores given by human pathologists - 95% for Ki67, 92% for HER2, 88% for ER, and 82% for PR. Importantly, the system even caught some cases where the pathologists' original scores were incorrect, and the automated score was better. This suggests the system could improve the accuracy of IHC analysis and lead to better treatment decisions, especially in situations where expert pathologists are not readily available.
Technical Explanation
The researchers developed a deep learning-based, fully automated decision support system (DSS) for IHC scoring of invasive ductal carcinoma, the most common type of breast cancer. The system was trained in a semi-supervised manner using:
- 3 million pathologist-annotated image patches from 300 slides
- 50,000 in-house cell annotations
- 40,000 pixels marking HER2 membrane
The system automatically detects the tumor region, removes artifacts, and scores the biomarkers according to the standard Allred scoring system. This deep learning-based prediction model was tested at four different centers using slides scanned by three different types of digital scanners.
The system achieved impressive percentage agreements with pathologist scores:
- 95% for Ki67
- 92% for HER2
- 88% for ER
- 82% for PR
Notably, the researchers found that in 5% of cases, pathologists changed their original scores in favor of the algorithm's score after reviewing the detailed algorithmic analysis. This suggests the system can improve the accuracy of IHC scoring and subsequent treatment decisions, especially where specialist expertise is limited.
The researchers also note that the proposed algorithm modules can be used to develop similar decision support systems for other cancer types beyond just breast cancer. The system is described as highly modular, indicating its potential for broader application.
Critical Analysis
The researchers provide a thorough validation of their automated IHC scoring system, testing it across multiple clinical centers and scanner types. This helps demonstrate the system's robustness and potential for real-world deployment.
However, the paper does not address certain limitations that could be important to consider. For example, it does not discuss how the system would perform on more challenging cases, such as those with significant tumor heterogeneity or unusual morphological features. Additionally, the long-term clinical impact of adopting such a system, in terms of improved patient outcomes, is not evaluated.
Further research could also explore the system's ability to segment benign epithelial cells in situ and predict the risk of early-stage breast cancer recurrence, which could provide additional valuable insights beyond just IHC scoring.
Overall, this research represents a promising step towards more accurate and objective IHC analysis, which could lead to better-informed treatment decisions for breast cancer patients. However, continued evaluation and further refinement of the system are needed to fully assess its clinical utility and impact.
Conclusion
This paper presents a deep learning-based, fully automated decision support system for IHC scoring of breast cancer, which aims to address the subjectivity and reproducibility issues associated with manual scoring. The system achieves high agreement with pathologist scores across multiple biomarkers and clinical settings, and in some cases, even corrects pathologist errors.
If adopted, this automated IHC scoring system could improve the accuracy of prognosis and treatment selection for breast cancer patients, particularly in areas where specialized pathology expertise is scarce. Moreover, the modular nature of the system suggests its potential for adaptation to other cancer types, further expanding its utility in the field of oncology.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
✅
0
Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma
Sumit Kumar Jha, Purnendu Mishra, Shubham Mathur, Gursewak Singh, Rajiv Kumar, Kiran Aatre, Suraj Rengarajan
Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is needed under IHC procedure to decide prognosis as well as predictors of response to therapy. However, IHC scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility, high subjectivity, and often incorrect scoring in low-score cases. In this paper, we present, a deep learning-based semi-supervised trained, fully automatic, decision support system (DSS) for IHC scoring of invasive ductal carcinoma. Our system automatically detects the tumor region removing artifacts and scores based on Allred standard. The system is developed using 3 million pathologist-annotated image patches from 300 slides, fifty thousand in-house cell annotations, and forty thousand pixels marking of HER2 membrane. We have conducted multicentric trials at four centers with three different types of digital scanners in terms of percentage agreement with doctors. And achieved agreements of 95, 92, 88 and 82 percent for Ki67, HER2, ER, and PR stain categories, respectively. In addition to overall accuracy, we found that there is 5 percent of cases where pathologist have changed their score in favor of algorithm score while reviewing with detailed algorithmic analysis. Our approach could improve the accuracy of IHC scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. Our system is highly modular. The proposed algorithm modules can be used to develop DSS for other cancer types.
Read more6/18/2024
🤷
0
Generalizing AI-driven Assessment of Immunohistochemistry across Immunostains and Cancer Types: A Universal Immunohistochemistry Analyzer
Biagio Brattoli, Mohammad Mostafavi, Taebum Lee, Wonkyung Jung, Jeongun Ryu, Seonwook Park, Jongchan Park, Sergio Pereira, Seunghwan Shin, Sangjoon Choi, Hyojin Kim, Donggeun Yoo, Siraj M. Ali, Kyunghyun Paeng, Chan-Young Ock, Soo Ick Cho, Seokhwi Kim
Despite advancements in methodologies, immunohistochemistry (IHC) remains the most utilized ancillary test for histopathologic and companion diagnostics in targeted therapies. However, objective IHC assessment poses challenges. Artificial intelligence (AI) has emerged as a potential solution, yet its development requires extensive training for each cancer and IHC type, limiting versatility. We developed a Universal IHC (UIHC) analyzer, an AI model for interpreting IHC images regardless of tumor or IHC types, using training datasets from various cancers stained for PD-L1 and/or HER2. This multi-cohort trained model outperforms conventional single-cohort models in interpreting unseen IHCs (Kappa score 0.578 vs. up to 0.509) and consistently shows superior performance across different positive staining cutoff values. Qualitative analysis reveals that UIHC effectively clusters patches based on expression levels. The UIHC model also quantitatively assesses c-MET expression with MET mutations, representing a significant advancement in AI application in the era of personalized medicine and accumulating novel biomarkers.
Read more7/31/2024
🤿
0
Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images
Masoud Tafavvoghi, Anders Sildnes, Mehrdad Rakaee, Nikita Shvetsov, Lars Ailo Bongo, Lill-Tove Rasmussen Busund, Kajsa M{o}llersen
Classifying breast cancer molecular subtypes is crucial for tailoring treatment strategies. While immunohistochemistry (IHC) and gene expression profiling are standard methods for molecular subtyping, IHC can be subjective, and gene profiling is costly and not widely accessible in many regions. Previous approaches have highlighted the potential application of deep learning models on H&E-stained whole slide images (WSI) for molecular subtyping, but these efforts vary in their methods, datasets, and reported performance. In this work, we investigated whether H&E-stained WSIs could be solely leveraged to predict breast cancer molecular subtypes (luminal A, B, HER2-enriched, and Basal). We used 1,433 WSIs of breast cancer in a two-step pipeline: first, classifying tumor and non-tumor tiles to use only the tumor regions for molecular subtyping; and second, employing a One-vs-Rest (OvR) strategy to train four binary OvR classifiers and aggregating their results using an eXtreme Gradient Boosting (XGBoost) model. The pipeline was tested on 221 hold-out WSIs, achieving an overall macro F1 score of 0.95 for tumor detection and 0.73 for molecular subtyping. Our findings suggest that, with further validation, supervised deep learning models could serve as supportive tools for molecular subtyping in breast cancer. Our codes are made available to facilitate ongoing research and development.
Read more9/17/2024
0
Advancing H&E-to-IHC Stain Translation in Breast Cancer: A Multi-Magnification and Attention-Based Approach
Linhao Qu, Chengsheng Zhang, Guihui Li, Haiyong Zheng, Chen Peng, Wei He
Breast cancer presents a significant healthcare challenge globally, demanding precise diagnostics and effective treatment strategies, where histopathological examination of Hematoxylin and Eosin (H&E) stained tissue sections plays a central role. Despite its importance, evaluating specific biomarkers like Human Epidermal Growth Factor Receptor 2 (HER2) for personalized treatment remains constrained by the resource-intensive nature of Immunohistochemistry (IHC). Recent strides in deep learning, particularly in image-to-image translation, offer promise in synthesizing IHC-HER2 slides from H&E stained slides. However, existing methodologies encounter challenges, including managing multiple magnifications in pathology images and insufficient focus on crucial information during translation. To address these issues, we propose a novel model integrating attention mechanisms and multi-magnification information processing. Our model employs a multi-magnification processing strategy to extract and utilize information from various magnifications within pathology images, facilitating robust image translation. Additionally, an attention module within the generative network prioritizes critical information for image distribution translation while minimizing less pertinent details. Rigorous testing on a publicly available breast cancer dataset demonstrates superior performance compared to existing methods, establishing our model as a state-of-the-art solution in advancing pathology image translation from H&E to IHC staining.
Read more8/6/2024