Transformer-based multiclass segmentation pipeline for basic kidney histology

Abstract

Multiclass segmentation of microanatomy in kidney biopsies is an important and non-trivial task in computational renal pathology. In a multicenter study, we densely annotated basic anatomical objects (glomeruli, tubules, and vessels) in 261 regions of interest of 147 kidney biopsy WSIs sourced from the archives of hospitals in Amsterdam, Utrecht,and Leiden (Netherlands). And we trained multiple UNet- and Mask2Former-based models on WSI-level and patch-level splitting methods, and compared their performance across training strategies. Test performance was assessed on 24 annotated renal WSIs from Leuven (Belgium) with sensitivity analysis on the extent of fibrosis and inflammation. At the patch-level, UNet-ResNet18 achieved comparable performances to M2F-Swin-B with average Intersection over Union of all classes (A-IoU, 0.84 vs 0.94), as well as per-class IoU. However, at the WSI-level, M2F-Swin-B significantly surpassed UNet-ResNet18 with large margins on A-IoU (0.84 vs 0.48), with similar observed in per-class IoU. Notably, M2F-Swin-B outperformed UNet-ResNet18 in scenarios characterized by a higher degree of fibrosis and inflammation (A-IoU, 0.76 vs 0.66). Furthermore, at the WSI-level, M2F-Swin-B achieved IoU score of arteries to 0.58, whereas UNet-ResNet18 only achieved 0.33. In this study, we found that the attention mechanism in Mask2Former enables visibly crisper and more uniform segmentation, particularly when data is inadequate. Mask2Former-based models outperform UNet-based models in challenging areas from inflamed and fibrotic renal biopsies.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

This work was supported by grants from Chongqing Science and health joint medical research project (general program, 2024MSXM017) and the New Chongqing Talent Attraction Program Research Project (CQYC20230A04254).

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Ethics committee of Leiden University Medical Center, Amsterdam University Medical Center, KU Leuven University,and Utrecht University Medical Center gave ethical approval for this work.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

All data produced in the present study are available upon reasonable request to the authors.

Comments (0)

No login
gif