Strength
What it is useful for
- Better matches observable information under occlusion and self-occlusion than full-model ADD.
- Can accept visually indistinguishable equivalent poses as correct.
BOP / visible-surface error · error
Visible Surface Discrepancy
Compares only object surfaces that should be visible in the image, treating indistinguishable poses as equivalent.
VSD renders depth under predicted and ground-truth poses, then uses test-image depth to derive visibility. It is particularly useful for occlusion, symmetry, and actual scene visibility.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
When an object is occluded, the image cannot establish whether its back surface is aligned; VSD therefore evaluates only visible surfaces.
Visible pixels with depth differences below τ are considered consistent, while nonvisible or misaligned regions count as inconsistent.
How to compute
Render object distance maps under predicted and ground-truth poses.
Combine them with test-scene depth to obtain visibility masks for both poses.
Compare depth over the union of the masks, using τ to compute pixel-level discrepancy.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Anna Šárová Mikeštíková, Médéric Fourmy, Martin Cifka et al.
CVPR · Yuchen Che, Jingtu Wu, Hao Zheng et al.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
AAAI · Dexin Zuo, Ang Li, Wei Wang et al.
3DV · Sebastian Jung, Leonard Klüpfel, Rudolph Triebel et al.
ICRA · Panagiotis Sapoutzoglou, Orestis Vaggelis, Athina Zacharia et al.
ICRA / IEEE RA-L · Francesco Di Felice, Alberto Remus, Stefano Gasperini et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
CVPR · Jianqi Chen, Biao Zhang, Xiangjun Tang et al.
CVPR · Wubin Shi, Shaoyan Gai, Feipeng Da
WACV · Sajjad Pakdamansavoji, Yintao Ma, Amir Rasouli et al.
CVPR · Taeyeop Lee, Bowen Wen, Minjun Kang et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Tuo Cao, Fei Luo, Jiongming Qin et al.
ICCV · Xinhang Liu, Jiawei Shi, Zheng Dang et al.
CVPR · Mengya Liu, Siyuan Li, Ajad Chhatkuli et al.
CVPR · Weijian Deng, Dylan Campbell, Chunyi Sun et al.
WACV · Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel et al.
ICCV · Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu et al.
WACV · Varun Burde, Assia Benbihi, Pavel Burget et al.
CVPR · Jaeguk Kim, Jaewoo Park, Keuntek Lee et al.
CVPR · Qingyuan Wang, Rui Song, Jiaojiao Li et al.
CVPR · Ming-Feng Li, Xin Yang, Fu-En Wang et al.
CVPR · Xingyu Liu, Gu Wang, Ruida Zhang et al.
IEEE TCSVT · Jianqiu Chen, Zikun Zhou, Mingshan Sun et al.
CVPR · Tianfu Wang, Guosheng Hu, Hongguang Wang
CVPR · Bowen Wen, Wei Yang, Jan Kautz et al.
ECCV · Evin Pınar Örnek, Yann Labbé, Bugra Tekin et al.
ECCV · Andrea Caraffa, Davide Boscaini, Amir Hamza et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann et al.
CVPR · Junwen Huang, Hao Yu, Kuan-Ting Yu et al.
CVPR · Yuelong Li, Yafei Mao, Raja Bala et al.
CVPR · Van Nguyen Nguyen, Thibault Groueix, Georgy Ponimatkin et al.
CVPR · Jaime Corsetti, Davide Boscaini, Changjae Oh et al.
ECCV · Yang You, Kai Xiong, Zhening Yang et al.
ECCV · Yangzheng Wu, Michael Greenspan
CVPR · Jiehong Lin, Lihua Liu, Dekun Lu et al.
CVPR · Tsu-Ching Hsiao, Hao-Wei Chen, Hsuan-Kung Yang et al.
ICRA · Philipp Ausserlechner, David Haberger, Stefan Thalhammer et al.
CoRL · Yann Labbé, Lucas Manuelli, Arsalan Mousavian et al.
CVPR · Gu Wang, Fabian Manhardt, Federico Tombari et al.
ECCV · Yann Labbé, Justin Carpentier, Mathieu Aubry et al.
CVPR · Tomas Hodan, Daniel Barath, Jiri Matas
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Maximum Symmetry-Aware Surface Distance
Maximum Symmetry-Aware Projection Distance
BOP Average Recall