组织学基础模型何时需要几何测试时增强?
When Do Histology Foundation Models Need Geometric Test-Time Augmentation?
Lars Chen, Valentino F. Foit, Dorry Segev, Michal Mankowski
AI 速读 基于摘要
作者报告在组织学基础模型上,D4测试时增强的收益随模型规模增大而减小,熵路由可选择性应用TTA以降低计算开销,且块级TTA提升不迁移到全切片级MIL。
cs.CV · cs.LG
查看原文摘要
Test-time augmentation (TTA) aggregates model predictions across multiple transformed views of an input during inference. Because histology images lack a canonical orientation, $D_4$ TTA---pooling across the 8 rotations and reflections of a square---is a standard default in computational pathology. However, the rise of self-supervised histology foundation models (FMs) with inherent rotational invariance calls its continued utility into question. We benchmark 9 histology FMs and 6 general-purpose models across four patch-level and two whole-slide image (WSI) datasets. We find that $D_4$ TTA remains a reliable post hoc improvement, but benefits diminish from $+1.98$ percentage points (pp) for general-purpose backbones to $+0.50$ pp for histology FMs on TCGA-UT, and shrink further for the largest models. To eliminate computational overhead, our experiments demonstrate that entropy routing---applying TTA selectively to uncertain predictions---recovers most of the gain while augmenting only ${\sim}13\%$ of samples. Finally, we show that patch-level TTA improvements do not transfer to slide-level multiple instance learning (MIL). Code: https://github.com/lars-chen/histology-tta