Deep learning-based classification of breast cancer molecular subtypes from H&E whole-slide images

Overview

• Classifying breast cancer molecular subtypes is crucial for tailoring treatment strategies.
• Immunohistochemistry (IHC) and gene expression profiling are standard methods, but IHC can be subjective and gene profiling is costly.
• Previous deep learning approaches have used H&E-stained whole slide images (WSI) for molecular subtyping, with varying methods and performance.
• This research investigates whether H&E-stained WSIs can be used to solely predict breast cancer molecular subtypes.

Plain English Explanation

Breast cancer is a complex disease, and understanding the specific molecular characteristics of a tumor is important for choosing the most effective treatment. Currently, doctors use two main methods to determine these molecular subtypes: immunohistochemistry (IHC) and gene expression profiling. IHC involves staining and examining tumor samples under a microscope, but this can be subjective. Gene expression profiling provides more detailed molecular information, but it is expensive and not widely available in many regions.

Previous research has shown that deep learning models, which are a type of artificial intelligence, may be able to determine breast cancer molecular subtypes by analyzing digital images of tumor samples. These models can "learn" to recognize patterns in the images that correspond to different subtypes. However, the methods and results of these previous studies have varied.

In this new research, the scientists investigated whether deep learning models could accurately predict breast cancer molecular subtypes using only H&E-stained whole slide images (WSIs) - digital images that capture an entire tumor sample. This would be a more efficient and accessible approach compared to the current standard methods.

The researchers developed a two-step deep learning pipeline to first identify the tumor regions in the WSIs, and then classify the molecular subtypes based on those tumor regions. They tested this pipeline on a dataset of 221 WSIs and achieved promising results, with an overall accuracy of 73% for molecular subtyping.

These findings suggest that deep learning models could potentially be used as supportive tools to help doctors determine breast cancer molecular subtypes, particularly in regions where the standard methods are not readily available. However, the approach still needs further validation before it could be widely used in clinical practice.

Technical Explanation

The researchers used a two-step pipeline to predict breast cancer molecular subtypes from H&E-stained whole slide images (WSIs):

1. Tumor tile classification: The first step was to classify individual tiles (small image regions) within the WSIs as either "tumor" or "non-tumor" using a deep learning model. This allowed the researchers to focus only on the tumor regions for the subsequent molecular subtyping.

2. Molecular subtyping: The second step employed an One-vs-Rest (OvR) strategy, where four binary OvR classifiers were trained to distinguish each molecular subtype (luminal A, luminal B, HER2-enriched, and basal) from the other subtypes. The results of these four classifiers were then aggregated using an XGBoost model to make the final subtype prediction.

The pipeline was trained and evaluated on a dataset of 1,433 WSIs of breast cancer samples, with 221 held-out for testing. The tumor detection model achieved a macro F1 score of 0.95, and the molecular subtyping model achieved a macro F1 score of 0.73 on the test set.

The researchers made their code available to facilitate ongoing research and development in this area. They suggest that, with further validation, supervised deep learning models could serve as supportive tools for molecular subtyping in breast cancer, potentially improving access to this crucial information in regions where standard methods are not readily available.

Critical Analysis

The researchers acknowledge several limitations of their study. First, the dataset used was relatively small, and the performance of the models may need to be evaluated on larger and more diverse datasets to assess their robustness. Second, the study did not directly compare the deep learning-based approach to the standard IHC and gene expression profiling methods, which would be important for understanding its practical utility.

Additionally, the researchers did not provide much detail on the specific architectural choices and hyperparameter tuning of the deep learning models, making it difficult to assess the technical merits of the approach. Further research could explore different model architectures and training strategies to potentially improve the molecular subtyping performance.

It would also be valuable to understand the types of errors made by the deep learning models, as well as the specific image features they are learning to discriminate between subtypes. This could provide insights into the underlying biological differences captured by the models and guide further refinements.

Despite these limitations, the researchers have demonstrated the potential of deep learning for breast cancer molecular subtyping using readily available H&E-stained WSIs. This could be a promising avenue for improving access to this crucial information, particularly in resource-limited settings. Further research and validation will be necessary before this approach could be considered for clinical deployment.

Conclusion

This research investigates the use of deep learning models to predict breast cancer molecular subtypes using only H&E-stained whole slide images, without relying on the more subjective IHC or costly gene expression profiling methods. The researchers developed a two-step pipeline that first identifies tumor regions in the images and then classifies the molecular subtypes, achieving promising results.

While the approach still requires further validation and refinement, the findings suggest that deep learning could serve as a supportive tool for molecular subtyping in breast cancer, potentially improving access to this important information in regions where standard methods are not widely available. Continued research and development in this area could lead to more efficient and accessible breast cancer diagnosis and treatment strategies.