Immunohistochemistry guided segmentation of benign epithelial cells, in situ lesions, and invasive epithelial cells in breast cancer slides
0
🤷
Sign in to get full access
Overview
- This paper explores the use of artificial intelligence (AI) for automatic analysis of breast cancer histopathology slides.
- The key goal is to develop an AI model that can accurately segment epithelial cells in these images, which is an important first step for building predictive models that associate morphological features with clinical outcomes.
- The researchers used immunohistochemistry (IHC) staining and pathologist annotations to generate ground truth masks, then trained a convolutional neural network on these labeled data.
- The model was evaluated on tissue microarrays (TMAs) and whole slide images from several cohorts of breast cancer patients.
Plain English Explanation
Analyzing breast cancer tissue samples under a microscope is a crucial part of diagnosing and monitoring the disease. However, manually reviewing these histopathological slides is time-consuming and can be subjective. Digital pathology offers a potential solution by using AI to automatically analyze the tissue samples.
In this study, the researchers aimed to develop an AI model that could accurately identify and segment the different types of epithelial cells in breast cancer samples. Epithelial cells are an important feature, as the transition from normal benign cells to invasive, cancerous cells is a key part of tumor progression. Being able to reliably distinguish these cell types would be a valuable first step for building predictive models that could help clinicians better understand the relationship between cellular morphology and clinical outcomes, such as risk of recurrence.
To train their AI model, the researchers used a technique called immunohistochemistry (IHC) to stain the tissue samples and highlight the epithelial cells. They then had pathologists manually annotate the different cell types, providing a detailed "ground truth" to serve as the training data for the AI system.
The resulting model was able to segment the epithelial cells with a high degree of accuracy, as evaluated on a large set of tissue samples from multiple cohorts of breast cancer patients. While there is still room for improvement, particularly in distinguishing between benign and in situ lesions, this work represents an important step forward in leveraging AI for digital pathology.
Technical Explanation
The researchers used a convolutional neural network architecture to develop their epithelial cell segmentation model. They trained the model on paired hematoxylin and eosin (H&E) and cytokeratin (CK) AE1/AE3 IHC stained images, where the CK staining provided the ground truth delineation of the epithelial cells.
Data augmentation techniques were employed to increase the robustness of the model, including random flipping, rotation, and scaling of the input images. The training and evaluation were performed on tissue microarrays (TMAs) from 839 patients, as well as whole slide images from two additional patients, all spanning four different breast cancer cohorts.
In quantitative evaluation, the model achieved mean Dice scores of 0.70, 0.79, and 0.75 for segmenting invasive epithelial cells, benign epithelial cells, and in situ lesions, respectively. Qualitative scoring by pathologists resulted in the highest scores for all epithelium (4.7 out of 5) and invasive epithelium (4.4 out of 5), while benign epithelium and in situ lesions scored 3.7 and 2.0, respectively.
Critical Analysis
The researchers acknowledge that further work is needed to improve the model's ability to accurately distinguish between the different epithelial cell subtypes, particularly benign cells and in situ lesions. This is an important limitation, as being able to reliably identify invasive cancer cells is a critical requirement for building clinically useful predictive models.
Additionally, the evaluation was performed on a relatively small number of whole slide images (two patients), so more extensive validation on larger, more diverse datasets would be beneficial to assess the model's real-world performance. The use of TMA samples, while convenient for model training and evaluation, may not fully capture the heterogeneity present in whole tissue sections.
Future research could also explore incorporating additional data modalities, such as genomic or clinical information, to help the AI system better contextualize the morphological features and improve its ability to distinguish between different epithelial cell types.
Conclusion
This study demonstrates the potential of AI-powered digital pathology to automate the analysis of breast cancer histopathology slides. By developing an accurate model for segmenting epithelial cells, the researchers have taken an important step towards building more advanced predictive models that could aid clinicians in diagnosis, prognosis, and treatment planning for breast cancer patients.
While further refinement is needed, this work highlights the value of leveraging both computational techniques and pathologist expertise to create robust, clinically relevant AI systems for healthcare applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤷
0
Immunohistochemistry guided segmentation of benign epithelial cells, in situ lesions, and invasive epithelial cells in breast cancer slides
Maren H{o}ib{o}, Andr'e Pedersen, Vibeke Grotnes Dale, Sissel Marie Berget, Borgny Ytterhus, Cecilia Lindskog, Elisabeth Wik, Lars A. Akslen, Ingerid Reinertsen, Erik Smistad, Marit Valla
Digital pathology enables automatic analysis of histopathological sections using artificial intelligence (AI). Automatic evaluation could improve diagnostic efficiency and help find associations between morphological features and clinical outcome. For development of such prediction models, identifying invasive epithelial cells, and separating these from benign epithelial cells and in situ lesions would be the first step. In this study, we aimed to develop an AI model for segmentation of epithelial cells in sections from breast cancer. We generated epithelial ground truth masks by restaining hematoxylin and eosin (HE) sections with cytokeratin (CK) AE1/AE3, and by pathologists' annotations. HE/CK image pairs were used to train a convolutional neural network, and data augmentation was used to make the model more robust. Tissue microarrays (TMAs) from 839 patients, and whole slide images from two patients were used for training and evaluation of the models. The sections were derived from four cohorts of breast cancer patients. TMAs from 21 patients from a fifth cohort was used as a second test set. In quantitative evaluation, a mean Dice score of 0.70, 0.79, and 0.75 for invasive epithelial cells, benign epithelial cells, and in situ lesions, respectively, were achieved. In qualitative scoring (0-5) by pathologists, results were best for all epithelium and invasive epithelium, with scores of 4.7 and 4.4. Scores for benign epithelium and in situ lesions were 3.7 and 2.0. The proposed model segmented epithelial cells in HE stained breast cancer slides well, but further work is needed for accurate division between the classes. Immunohistochemistry, together with pathologists' annotations, enabled the creation of accurate ground truths. The model is made freely available in FastPathology and the code is available at https://github.com/AICAN-Research/breast-epithelium-segmentation
Read more6/17/2024
0
Deep Learning-based Prediction of Breast Cancer Tumor and Immune Phenotypes from Histopathology
Tiago Gonc{c}alves, Dagoberto Pulido-Arias, Julian Willett, Katharina V. Hoebel, Mason Cleveland, Syed Rakin Ahmed, Elizabeth Gerstner, Jayashree Kalpathy-Cramer, Jaime S. Cardoso, Christopher P. Bridge, Albert E. Kim
The interactions between tumor cells and the tumor microenvironment (TME) dictate therapeutic efficacy of radiation and many systemic therapies in breast cancer. However, to date, there is not a widely available method to reproducibly measure tumor and immune phenotypes for each patient's tumor. Given this unmet clinical need, we applied multiple instance learning (MIL) algorithms to assess activity of ten biologically relevant pathways from the hematoxylin and eosin (H&E) slide of primary breast tumors. We employed different feature extraction approaches and state-of-the-art model architectures. Using binary classification, our models attained area under the receiver operating characteristic (AUROC) scores above 0.70 for nearly all gene expression pathways and on some cases, exceeded 0.80. Attention maps suggest that our trained models recognize biologically relevant spatial patterns of cell sub-populations from H&E. These efforts represent a first step towards developing computational H&E biomarkers that reflect facets of the TME and hold promise for augmenting precision oncology.
Read more4/26/2024
✅
0
Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma
Sumit Kumar Jha, Purnendu Mishra, Shubham Mathur, Gursewak Singh, Rajiv Kumar, Kiran Aatre, Suraj Rengarajan
Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is needed under IHC procedure to decide prognosis as well as predictors of response to therapy. However, IHC scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility, high subjectivity, and often incorrect scoring in low-score cases. In this paper, we present, a deep learning-based semi-supervised trained, fully automatic, decision support system (DSS) for IHC scoring of invasive ductal carcinoma. Our system automatically detects the tumor region removing artifacts and scores based on Allred standard. The system is developed using 3 million pathologist-annotated image patches from 300 slides, fifty thousand in-house cell annotations, and forty thousand pixels marking of HER2 membrane. We have conducted multicentric trials at four centers with three different types of digital scanners in terms of percentage agreement with doctors. And achieved agreements of 95, 92, 88 and 82 percent for Ki67, HER2, ER, and PR stain categories, respectively. In addition to overall accuracy, we found that there is 5 percent of cases where pathologist have changed their score in favor of algorithm score while reviewing with detailed algorithmic analysis. Our approach could improve the accuracy of IHC scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. Our system is highly modular. The proposed algorithm modules can be used to develop DSS for other cancer types.
Read more6/18/2024
👀
0
Data-driven Nucleus Subclassification on Colon H&E using Style-transferred Digital Pathology
Lucas W. Remedios, Shunxing Bao, Samuel W. Remedios, Ho Hin Lee, Leon Y. Cai, Thomas Li, Ruining Deng, Nancy R. Newlin, Adam M. Saunders, Can Cui, Jia Li, Qi Liu, Ken S. Lau, Joseph T. Roland, Mary K Washington, Lori A. Coburn, Keith T. Wilson, Yuankai Huo, Bennett A. Landman
Understanding the way cells communicate, co-locate, and interrelate is essential to furthering our understanding of how the body functions. H&E is widely available, however, cell subtyping often requires expert knowledge and the use of specialized stains. To reduce the annotation burden, AI has been proposed for the classification of cells on H&E. For example, the recent Colon Nucleus Identification and Classification (CoNIC) Challenge focused on labeling 6 cell types on H&E of the colon. However, the CoNIC Challenge was unable to classify epithelial subtypes (progenitor, enteroendocrine, goblet), lymphocyte subtypes (B, helper T, cytotoxic T), and connective subtypes (fibroblasts). We use inter-modality learning to label previously un-labelable cell types on H&E. We take advantage of multiplexed immunofluorescence (MxIF) histology to label 14 cell subclasses. We performed style transfer on the same MxIF tissues to synthesize realistic virtual H&E which we paired with the MxIF-derived cell subclassification labels. We evaluated the efficacy of using a supervised learning scheme where the input was realistic-quality virtual H&E and the labels were MxIF-derived cell subclasses. We assessed our model on private virtual H&E and public real H&E. On virtual H&E, we were able to classify helper T cells and epithelial progenitors with positive predictive values of $0.34 pm 0.15$ (prevalence $0.03 pm 0.01$) and $0.47 pm 0.1$ (prevalence $0.07 pm 0.02$) respectively, when using ground truth centroid information. On real H&E we could classify helper T cells and epithelial progenitors with upper bound positive predictive values of $0.43 pm 0.03$ (parent class prevalence 0.21) and $0.94 pm 0.02$ (parent class prevalence 0.49) when using ground truth centroid information. This is the first work to provide cell type classification for helper T and epithelial progenitor nuclei on H&E.
Read more7/9/2024