Sfumato Supervision: Learning Instance Segmentation with Noisy Labels
Moshe Kimhi, Ehud Rivlin, Chaim Baskin
原文摘要
Instance segmentation requires precise object masks, yet both human annotators and promptable models can produce unreliable contours. A high prediction loss near a contour does not necessarily indicate an annotation error: valid edges can also be uncertain. Inspired by Leonardo da Vinci's \emph{sfumato}, which softens transitions between a subject and its surroundings, we introduce \textbf{\texttt{CB-LNL} (Copula-Boundary Learning with Noisy Labels)}. Rather than judging each contour pixel alone, CB-LNL combines foreground evidence inside the mask with background evidence outside it to guide local supervision and annotation repair. We ground this approach in an audit of paired COCO and LVIS annotations, and introduce benchmarks covering human annotations, weak-prompt SAM2 masks, and controlled corruptions in natural and driving scenes. Controlled comparisons show improved training on procedural contour noise and fewer harmful edits than direct teacher-mask replacement. Paired-seed and frozen-prediction evaluations reveal how these benefits depend on the annotation source, supporting separate assessment of category and contour reliability.
cs.CV · cs.LG