Click3R:基于稀疏对应点击的交互式立体三维重建
Click3R: Interactive Stereo 3D Reconstruction with Sparse Correspondence Clicks
Hao Gu, Jin Yao, Zezhou Cheng
AI 速读 基于摘要
作者提出 Click3R,通过用户提供的少量跨视角对应点击,对前馈式立体三维重建模型进行交互式几何纠错。
cs.CV
查看原文摘要
Despite impressive progress, existing feed-forward large 3D reconstruction models produce a single, irrevocable prediction. When these models fail, there is no mechanism to correct their mistakes. To address this limitation, we introduce Click3R, a framework for interactive geometric correction of feed-forward models using sparse human correspondence clicks. Given an image pair and a small set of cross-view point correspondences provided by a user, Click3R injects geometric constraints into the 3D reconstruction networks through a lightweight point correspondence adapter, enabling the model to resolve ambiguities in challenging scenarios such as repetitive textures, symmetric structures, large viewpoint changes, or textureless regions. To evaluate interactive reconstruction, we curate a challenging benchmark specifically designed to expose failure modes of existing feed-forward 3D reconstruction methods. Experiments show that Click3R reduces reconstruction error with as few as a single correspondence click, improving performance on both standard and our curated benchmarks. Our results highlight that sparse human interaction provides an effective and practical mechanism for correcting geometric reconstruction errors.