Impact of Whole Slide Image Blurriness on the Robustness of Artificial Intelligence in Real World Setting: Retrospective Observational Study

Abstract

Context In digital pathology, blurriness in whole slide images (WSI) is a common issue, with severe blurriness widely acknowledge as a critical factor that can degrade the performance of artificial intelligence (AI) models. However, the effects of the typical levels of blurriness observed in real-world pathological images on the robustness of AI predictions remains unclear and unexplored.

Objective To evaluate the impact of WSI blurring on the robustness of AI prediction in real-world setting.

Design A retrospective study was conducted using 8,000 WSIs and corresponding AI predictions from four AI models trained on data from two scanners and two organs. WSIs were categorized into concordant and discordant groups based on AI-prediction accuracy. Analyses included: 1) comparing blur metrics between groups, 2) determining the odds ratio between the proportions of blurry patch in WSIs and prediction concordance, and 3) assessing model performance across varying blur intensities.

Results For each organ-scanner pair, the average wavelet score and Laplacian variance for WSIs between the two groups did not show a statistically significant difference model (p > 0.05 for both metrics), except for one, and their effect sizes were small (Cohen’s D < 0.2 for both metrics). Additionally, no statistically significant association was observed between AI prediction concordance and the proportion of blurry images in WSIs (confidence intervals included 1, respectively). Model performance remained robust even at high blur level (radius=1) at which patch image had Laplacian variance of 162.88 and a wavelet score of 1880.07, corresponding to the top 1.22% and 2.16% of blurriness respective, in our dataset.

Conclusions The findings empirically suggest that the typical levels of WSI blurriness encountered in real-world settings may not significantly compromise the robustness of AI predictions.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This study did not receive any funding

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study was approved by the institutional review board at Seegene Medical Foundation (SMF-IRB-2024-015). The anonymous and deidentified nature of the retrospective pathologic image made obtaining informed consent unnecessary

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

The data used in this study are not publicly available due to privacy and confidentiality restrictions

Comments (0)

No login
gif