Visual classification under domain and category shifts requires identifying which image regions provide transferable evidence. Domain alignment alone can retain context that is stable across source domains yet redundant for prediction, while new categories may require different local distinctions. We propose PatchGen to learn image-conditioned soft patch weights and regularize their contributions to the task representation. Low-score suppression acts directly on the weights, while selected-confidence and class-conditional compactness objectives shape the aggregated features using available labels or host-generated pseudo-labels. An oracle predictive-subset analysis characterizes information preservation, complexity upper bounds, and sensitivity to selection error under explicit assumptions. Experiments on natural and histopathological image benchmarks across all three shift settings show that PatchGen improves average performance over matched-backbone baselines in most evaluated configurations, enhances generalization to unknown classes, and remains competitive with vision-language methods without text supervision.
Zhaorui Tan, Jun Aun Tan, Weixiang Zhong, Xiaoxi Wang, Tan Pan, Xingdong Xue, Li Liu, Jing Zhang 等 10 位作者
原文摘要
Pathology reporting translates tissue observations across regions and slides into diagnoses and supporting morphological descriptions, yet explicit tissue-composition measurements are rarely used to guide H&E-based report generation. We developed PathXAI, which pairs transferable tissue segmentation with a pretrained vision-language model. Because supplying tissue information directly with H&E images gave limited benefit, PathXAI-Report uses segmentation overlays and tissue statistics in separate steps, selects between candidate diagnoses by fixed rules, acquires further images when evidence is insufficient and records every step for review, without updating model weights. Its segmentation component exceeded baselines in mean Dice on internal and external tests. In automated evaluation on 1,200 public and 151 private cases, PathXAI achieved higher agreement with reference diagnoses and documented morphology than H&E-based comparators. On the public cohort, it exceeded Qwen+H&E by 4.4 percentage points in cancer family match rate and 5.7 percentage points in finding F1.