Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs

Read original: arXiv:2403.07743 - Published 5/24/2024 by Neel Kanwal, Farbod Khoraminia, Umay Kiraz, Andres Mosquera-Zamudio, Carlos Monteagudo, Emiel A. M. Janssen, Tahlita C. M. Zuiverloon, Chunmig Rong, Kjersti Engan
Total Score

0

Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a framework for equipping computational pathology systems with artifact processing pipelines, which can help manage the trade-offs between computational complexity and performance.
  • The authors showcase the effectiveness of their approach through various experiments and demonstrate how it can be applied to existing computational pathology systems.

Plain English Explanation

In the field of computational pathology, which involves using computer algorithms to analyze medical images like tissue samples, there is a challenge around dealing with "artifacts" - unwanted distortions or defects in the images. These artifacts can negatively impact the performance of the computer algorithms and lead to inaccurate results.

The researchers in this paper have developed a framework to help computational pathology systems better handle these artifacts. Their framework includes a set of "processing pipelines" - a series of steps the computer can take to identify and remove or mitigate the effects of artifacts in the images.

By incorporating these artifact processing pipelines, the researchers show that computational pathology systems can maintain high performance while also reducing the overall computational complexity and resource requirements. This is important because it means the systems can run more efficiently, potentially allowing them to be deployed in more real-world clinical settings.

The researchers demonstrate the effectiveness of their framework through various experiments, showcasing how it can be integrated into existing computational pathology systems. This work has important implications for making these types of medical imaging analysis tools more practical and accessible for use in healthcare.

Technical Explanation

The paper introduces an artifact processing pipeline framework that can be integrated into computational pathology systems to better handle image artifacts. The framework includes modules for artifact detection, segmentation, and correction, allowing the system to dynamically adapt its processing based on the input data.

Through experiments, the authors demonstrate how this framework can enable trade-offs between computational complexity and performance. For example, they show that by selectively applying certain artifact processing steps, the system can maintain high accuracy while significantly reducing its resource requirements compared to a baseline approach.

The authors also showcase the generalizability of their framework by integrating it with existing computational pathology systems, including an interpretable machine learning system for colorectal cancer diagnosis and a full-resolution all-in-one system. They evaluate the performance impact and computational efficiency gains across these different use cases.

Critical Analysis

The paper provides a compelling case for the importance of addressing image artifacts in computational pathology systems. The proposed artifact processing framework offers a systematic way to manage the trade-offs between computational complexity and performance, which is a crucial consideration for real-world clinical deployment.

One potential limitation mentioned in the paper is the need for careful configuration of the artifact processing pipeline to balance the computational overhead and performance benefits. The authors acknowledge that the optimal pipeline may vary depending on the specific computational pathology system and dataset. Further research could explore more automated or adaptive approaches to pipeline configuration.

Additionally, while the authors demonstrate the generalizability of their framework, the paper does not provide in-depth analyses of the specific challenges or trade-offs encountered when integrating it with different computational pathology systems. More detailed case studies could help readers better understand the practical considerations and potential challenges.

Overall, this work represents an important contribution to the field of computational pathology, addressing a key challenge and providing a flexible framework that can potentially be applied to a wide range of systems to enhance their performance and efficiency.

Conclusion

This paper presents a novel artifact processing pipeline framework that can be integrated into computational pathology systems to manage the trade-offs between computational complexity and performance. Through various experiments, the authors demonstrate the effectiveness of their approach in detecting, segmenting, and correcting image artifacts, leading to significant efficiency gains without sacrificing accuracy.

The generalizability of the framework, as showcased by its integration with different computational pathology systems, highlights its potential for broader impact in the field. As computational pathology continues to play an increasingly important role in healthcare, tools like the one presented in this paper will be crucial for ensuring these systems are both clinically effective and practically deployable.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs
Total Score

0

Equipping Computational Pathology Systems with Artifact Processing Pipelines: A Showcase for Computation and Performance Trade-offs

Neel Kanwal, Farbod Khoraminia, Umay Kiraz, Andres Mosquera-Zamudio, Carlos Monteagudo, Emiel A. M. Janssen, Tahlita C. M. Zuiverloon, Chunmig Rong, Kjersti Engan

Histopathology is a gold standard for cancer diagnosis under a microscopic examination. However, histological tissue processing procedures result in artifacts, which are ultimately transferred to the digitized version of glass slides, known as whole slide images (WSIs). Artifacts are diagnostically irrelevant areas and may result in wrong deep learning (DL) algorithms predictions. Therefore, detecting and excluding artifacts in the computational pathology (CPATH) system is essential for reliable automated diagnosis. In this paper, we propose a mixture of experts (MoE) scheme for detecting five notable artifacts, including damaged tissue, blur, folded tissue, air bubbles, and histologically irrelevant blood from WSIs. First, we train independent binary DL models as experts to capture particular artifact morphology. Then, we ensemble their predictions using a fusion mechanism. We apply probabilistic thresholding over the final probability distribution to improve the sensitivity of the MoE. We developed DL pipelines using two MoEs and two multiclass models of state-of-the-art deep convolutional neural networks (DCNNs) and vision transformers (ViTs). DCNNs-based MoE and ViTs-based MoE schemes outperformed simpler multiclass models and were tested on datasets from different hospitals and cancer types, where MoE using DCNNs yielded the best results. The proposed MoE yields 86.15% F1 and 97.93% sensitivity scores on unseen data, retaining less computational cost for inference than MoE using ViTs. This best performance of MoEs comes with relatively higher computational trade-offs than multiclass models. The proposed artifact detection pipeline will not only ensure reliable CPATH predictions but may also provide quality control.

Read more

5/24/2024

Improving Quality Control of Whole Slide Images by Explicit Artifact Augmentation
Total Score

0

Improving Quality Control of Whole Slide Images by Explicit Artifact Augmentation

Artur Jurgas, Marek Wodzinski, Marina D'Amato, Jeroen van der Laak, Manfredo Atzori, Henning Muller

The problem of artifacts in whole slide image acquisition, prevalent in both clinical workflows and research-oriented settings, necessitates human intervention and re-scanning. Overcoming this challenge requires developing quality control algorithms, that are hindered by the limited availability of relevant annotated data in histopathology. The manual annotation of ground-truth for artifact detection methods is expensive and time-consuming. This work addresses the issue by proposing a method dedicated to augmenting whole slide images with artifacts. The tool seamlessly generates and blends artifacts from an external library to a given histopathology dataset. The augmented datasets are then utilized to train artifact classification methods. The evaluation shows their usefulness in classification of the artifacts, where they show an improvement from 0.10 to 0.01 AUROC depending on the artifact type. The framework, model, weights, and ground-truth annotations are freely released to facilitate open science and reproducible research.

Read more

6/18/2024

🖼️

Total Score

0

An interpretable machine learning system for colorectal cancer diagnosis from pathology slides

Pedro C. Neto, Diana Montezuma, Sara P. Oliveira, Domingos Oliveira, Jo~ao Fraga, Ana Monteiro, Jo~ao Monteiro, Liliana Ribeiro, Sofia Gonc{c}alves, Stefan Reinhard, Inti Zlobec, Isabel M. Pinto, Jaime S. Cardoso

Considering the profound transformation affecting pathology practice, we aimed to develop a scalable artificial intelligence (AI) system to diagnose colorectal cancer from whole-slide images (WSI). For this, we propose a deep learning (DL) system that learns from weak labels, a sampling strategy that reduces the number of training samples by a factor of six without compromising performance, an approach to leverage a small subset of fully annotated samples, and a prototype with explainable predictions, active learning features and parallelisation. Noting some problems in the literature, this study is conducted with one of the largest WSI colorectal samples dataset with approximately 10,500 WSIs. Of these samples, 900 are testing samples. Furthermore, the robustness of the proposed method is assessed with two additional external datasets (TCGA and PAIP) and a dataset of samples collected directly from the proposed prototype. Our proposed method predicts, for the patch-based tiles, a class based on the severity of the dysplasia and uses that information to classify the whole slide. It is trained with an interpretable mixed-supervision scheme to leverage the domain knowledge introduced by pathologists through spatial annotations. The mixed-supervision scheme allowed for an intelligent sampling strategy effectively evaluated in several different scenarios without compromising the performance. On the internal dataset, the method shows an accuracy of 93.44% and a sensitivity between positive (low-grade and high-grade dysplasia) and non-neoplastic samples of 0.996. On the external test samples varied with TCGA being the most challenging dataset with an overall accuracy of 84.91% and a sensitivity of 0.996.

Read more

5/2/2024

🤖

Total Score

0

Beyond Multiple Instance Learning: Full Resolution All-In-Memory End-To-End Pathology Slide Modeling

Gabriele Campanella, Eugene Fluder, Jennifer Zeng, Chad Vanderbilt, Thomas J. Fuchs

Artificial Intelligence (AI) has great potential to improve health outcomes by training systems on vast digitized clinical datasets. Computational Pathology, with its massive amounts of microscopy image data and impact on diagnostics and biomarkers, is at the forefront of this development. Gigapixel pathology slides pose a unique challenge due to their enormous size and are usually divided into tens of thousands of smaller tiles for analysis. This results in a discontinuity in the machine learning process by separating the training of tile-level encoders from slide-level aggregators and the need to adopt weakly supervised learning strategies. Training models from entire pathology slides end-to-end has been largely unexplored due to its computational challenges. To overcome this problem, we propose a novel approach to jointly train both a tile encoder and a slide-aggregator fully in memory and end-to-end at high-resolution, bridging the gap between input and slide-level supervision. While more computationally expensive, detailed quantitative validation shows promise for large-scale pre-training and fine-tuning of pathology foundation models.

Read more

5/24/2024