Generalizing AI-driven Assessment of Immunohistochemistry across Immunostains and Cancer Types: A Universal Immunohistochemistry Analyzer
0
🤷
Sign in to get full access
Overview
- Immunohistochemistry (IHC) is the most widely used additional test for diagnosing diseases and guiding targeted therapies.
- Accurately interpreting IHC results is challenging, and artificial intelligence (AI) has emerged as a potential solution.
- However, existing AI models require extensive training for each cancer and IHC type, limiting their versatility.
Plain English Explanation
The paper describes the development of a Universal IHC (UIHC) analyzer, an AI model that can interpret IHC images regardless of the type of cancer or IHC marker being used. This is a significant advancement, as previous AI models were limited to specific cancer and IHC types, making them less flexible.
The researchers trained the UIHC model using data from various cancers stained for PD-L1 and/or HER2. This multi-cohort approach allowed the model to learn patterns that are generalizable across different cancer and IHC types, rather than being specialized for a single type.
The UIHC model was then tested on unseen IHC images and was found to outperform conventional single-cohort models in accurately interpreting the results. The researchers also showed that the UIHC model can quantitatively assess c-MET expression in relation to MET mutations, which is an important biomarker in personalized medicine.
Technical Explanation
The researchers developed the UIHC analyzer, an AI model that can interpret IHC images regardless of the cancer or IHC type. They trained the model using datasets from various cancers stained for PD-L1 and/or HER2, a multi-cohort approach that enabled the model to learn generalizable patterns.
The UIHC model was then tested on unseen IHC images and outperformed conventional single-cohort models in accurately interpreting the results, as measured by the Kappa score (0.578 vs. up to 0.509). The researchers also found that the UIHC model consistently showed superior performance across different positive staining cutoff values.
Qualitative analysis revealed that the UIHC model effectively clustered image patches based on expression levels, demonstrating its ability to identify and differentiate between different staining patterns. Additionally, the UIHC model was capable of quantitatively assessing c-MET expression in relation to MET mutations, representing a significant advancement in the application of AI in personalized medicine and the analysis of novel biomarkers.
Critical Analysis
The researchers have made a significant contribution by developing a versatile AI model that can interpret IHC images regardless of the cancer or IHC type. This is a notable improvement over previous models, which were limited to specific types and required extensive retraining for each new application.
However, the paper does not address the potential limitations of the UIHC model, such as its performance on rare or uncommon cancer types or IHC markers. It would be valuable to understand the model's robustness and generalizability across a broader range of clinical scenarios.
Additionally, the paper does not provide a detailed comparison of the UIHC model's performance against human experts in interpreting IHC results. While the model outperforms single-cohort AI models, it would be important to assess its accuracy and reliability relative to the clinical gold standard of manual IHC assessment by pathologists.
Conclusion
The development of the Universal IHC (UIHC) analyzer represents a significant advancement in the application of AI for interpreting IHC images. By training the model on diverse datasets, the researchers have created a versatile tool that can be applied across various cancer and IHC types, overcoming the limitations of previous specialized AI models.
The UIHC model's superior performance in accurately interpreting unseen IHC images and its ability to quantitatively assess biomarkers like c-MET expression highlight its potential to enhance personalized medicine and the analysis of novel diagnostic markers. As the field of digital pathology continues to evolve, the UIHC model could play a crucial role in streamlining and standardizing the interpretation of IHC results, ultimately improving patient care and outcomes.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤷
0
Generalizing AI-driven Assessment of Immunohistochemistry across Immunostains and Cancer Types: A Universal Immunohistochemistry Analyzer
Biagio Brattoli, Mohammad Mostafavi, Taebum Lee, Wonkyung Jung, Jeongun Ryu, Seonwook Park, Jongchan Park, Sergio Pereira, Seunghwan Shin, Sangjoon Choi, Hyojin Kim, Donggeun Yoo, Siraj M. Ali, Kyunghyun Paeng, Chan-Young Ock, Soo Ick Cho, Seokhwi Kim
Despite advancements in methodologies, immunohistochemistry (IHC) remains the most utilized ancillary test for histopathologic and companion diagnostics in targeted therapies. However, objective IHC assessment poses challenges. Artificial intelligence (AI) has emerged as a potential solution, yet its development requires extensive training for each cancer and IHC type, limiting versatility. We developed a Universal IHC (UIHC) analyzer, an AI model for interpreting IHC images regardless of tumor or IHC types, using training datasets from various cancers stained for PD-L1 and/or HER2. This multi-cohort trained model outperforms conventional single-cohort models in interpreting unseen IHCs (Kappa score 0.578 vs. up to 0.509) and consistently shows superior performance across different positive staining cutoff values. Qualitative analysis reveals that UIHC effectively clusters patches based on expression levels. The UIHC model also quantitatively assesses c-MET expression with MET mutations, representing a significant advancement in AI application in the era of personalized medicine and accumulating novel biomarkers.
Read more7/31/2024
✅
0
Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma
Sumit Kumar Jha, Purnendu Mishra, Shubham Mathur, Gursewak Singh, Rajiv Kumar, Kiran Aatre, Suraj Rengarajan
Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is needed under IHC procedure to decide prognosis as well as predictors of response to therapy. However, IHC scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility, high subjectivity, and often incorrect scoring in low-score cases. In this paper, we present, a deep learning-based semi-supervised trained, fully automatic, decision support system (DSS) for IHC scoring of invasive ductal carcinoma. Our system automatically detects the tumor region removing artifacts and scores based on Allred standard. The system is developed using 3 million pathologist-annotated image patches from 300 slides, fifty thousand in-house cell annotations, and forty thousand pixels marking of HER2 membrane. We have conducted multicentric trials at four centers with three different types of digital scanners in terms of percentage agreement with doctors. And achieved agreements of 95, 92, 88 and 82 percent for Ki67, HER2, ER, and PR stain categories, respectively. In addition to overall accuracy, we found that there is 5 percent of cases where pathologist have changed their score in favor of algorithm score while reviewing with detailed algorithmic analysis. Our approach could improve the accuracy of IHC scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. Our system is highly modular. The proposed algorithm modules can be used to develop DSS for other cancer types.
Read more6/18/2024
0
IHC Matters: Incorporating IHC analysis to H&E Whole Slide Image Analysis for Improved Cancer Grading via Two-stage Multimodal Bilinear Pooling Fusion
Jun Wang, Yu Mao, Yufei Cui, Nan Guan, Chun Jason Xue
Immunohistochemistry (IHC) plays a crucial role in pathology as it detects the over-expression of protein in tissue samples. However, there are still fewer machine learning model studies on IHC's impact on accurate cancer grading. We discovered that IHC and H&E possess distinct advantages and disadvantages while possessing certain complementary qualities. Building on this observation, we developed a two-stage multi-modal bilinear model with a feature pooling module. This model aims to maximize the potential of both IHC and HE's feature representation, resulting in improved performance compared to their individual use. Our experiments demonstrate that incorporating IHC data into machine learning models, alongside H&E stained images, leads to superior predictive results for cancer grading. The proposed framework achieves an impressive ACC higher of 0.953 on the public dataset BCI.
Read more5/15/2024
0
Advancing H&E-to-IHC Stain Translation in Breast Cancer: A Multi-Magnification and Attention-Based Approach
Linhao Qu, Chengsheng Zhang, Guihui Li, Haiyong Zheng, Chen Peng, Wei He
Breast cancer presents a significant healthcare challenge globally, demanding precise diagnostics and effective treatment strategies, where histopathological examination of Hematoxylin and Eosin (H&E) stained tissue sections plays a central role. Despite its importance, evaluating specific biomarkers like Human Epidermal Growth Factor Receptor 2 (HER2) for personalized treatment remains constrained by the resource-intensive nature of Immunohistochemistry (IHC). Recent strides in deep learning, particularly in image-to-image translation, offer promise in synthesizing IHC-HER2 slides from H&E stained slides. However, existing methodologies encounter challenges, including managing multiple magnifications in pathology images and insufficient focus on crucial information during translation. To address these issues, we propose a novel model integrating attention mechanisms and multi-magnification information processing. Our model employs a multi-magnification processing strategy to extract and utilize information from various magnifications within pathology images, facilitating robust image translation. Additionally, an attention module within the generative network prioritizes critical information for image distribution translation while minimizing less pertinent details. Rigorous testing on a publicly available breast cancer dataset demonstrates superior performance compared to existing methods, establishing our model as a state-of-the-art solution in advancing pathology image translation from H&E to IHC staining.
Read more8/6/2024