Depth-Dominant Skeleton Detection for Natural Scenes
Chengkun Rao, Xinrong Hu, Min Li, Yangjun Ou, Ziwei Luo, Ye Li, Zhaojing Wang, Junwei Tang 等 10 位作者
原文摘要
Existing natural-scene skeleton detectors follow an RGB-representation-based feature encoding paradigm: they locate skeletons within the RGB appearance space, in which the skeleton's shape and topology can only be inferred implicitly from entangled color and texture cues. Despite notable progress, this encoding paradigm degrades markedly on complex scenes such as cluttered or occluded ones, where appearance distractors overwhelm the weak structural signal. We observe that depth images are inherently insensitive to color and texture and provide clear regional contours and inter-region spatial relationships, which naturally eases the difficulty of skeleton detection in complex scenes. Motivated by this, we propose for the first time a novel skeleton detection paradigm built on depth-representation-dominant feature encoding, in which depth dominates and RGB serves as the auxiliary, and present a model, DDSkel, under this paradigm. DDSkel adopts an asymmetric encoder design that fuses the feature representation of RGB images into that of depth images, with the RGB branch containing only 23% of the parameters of the depth branch. DDSkel has a simple structure without intricate designs. Nevertheless, with only about 19% of the trainable parameters of the largest state-of-the-art methods, DDSkel attains the highest F-measure scores on four mainstream benchmarks, namely SK506, SK-LARGE, WH-SYMMAX, and SymPASCAL. Extensive experiments suggest that for natural-image skeleton detection, the depth-dominant paradigm is a more suitable choice than the RGB-based paradigm, achieving better performance with substantially fewer parameters.
cs.CV