2412.09072

Total: 1

#1 Cross-View Completion Models are Zero-shot Correspondence Estimators [PDF3] [Copy] [Kimi1] [REL]

Authors: Honggyu An, Jinhyeon Kim, Seonghoon Park, Jaewoo Jung, Jisang Han, Sunghwan Hong, Seungryong Kim

In this work, we explore new perspectives on cross-view completion learning by drawing an analogy to self-supervised correspondence learning. Through our analysis, we demonstrate that the cross-attention map within cross-view completion models captures correspondence more effectively than other correlations derived from encoder or decoder features. We verify the effectiveness of the cross-attention map by evaluating on both zero-shot matching and learning-based geometric matching and multi-frame depth estimation. Project page is available at https://cvlab-kaist.github.io/ZeroCo/.

Subject: Computer Vision and Pattern Recognition

Publish: 2024-12-12 08:58:20 UTC