Strength
What it is useful for
- Symmetry-aware and directly reflects visual displacement.
- Requires no test depth and suits RGB-only BOP settings.
BOP / perceptual projection error · error
Maximum Symmetry-Aware Projection Distance
Measures the worst model-point displacement in image pixels after accounting for symmetry.
MSPD applies MSSD's worst-case principle in the image plane, making it useful for evaluating perceptible projection misalignment in RGB methods and AR.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
It first allows equivalent symmetric poses, then focuses on the vertex with the largest image displacement.
Small depth changes along the optical axis may yield small MSPD errors if they barely change the projection.
How to compute
Generate equivalent ground-truth projections using each symmetry transformation.
Compare the prediction with each candidate ground-truth projection using the maximum vertex distance in pixels.
Select the minimum, then compute recall or AP using BOP thresholds.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Anna Šárová Mikeštíková, Médéric Fourmy, Martin Cifka et al.
CVPR · Yuchen Che, Jingtu Wu, Hao Zheng et al.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
AAAI · Dexin Zuo, Ang Li, Wei Wang et al.
3DV · Sebastian Jung, Leonard Klüpfel, Rudolph Triebel et al.
ICRA · Panagiotis Sapoutzoglou, Orestis Vaggelis, Athina Zacharia et al.
ICRA / IEEE RA-L · Francesco Di Felice, Alberto Remus, Stefano Gasperini et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
CVPR · Jianqi Chen, Biao Zhang, Xiangjun Tang et al.
CVPR · Wubin Shi, Shaoyan Gai, Feipeng Da
WACV · Sajjad Pakdamansavoji, Yintao Ma, Amir Rasouli et al.
ECCV · Junwen Huang, Jiaqi Hu, Peter KT Yu et al.
CVPR · Taeyeop Lee, Bowen Wen, Minjun Kang et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Tuo Cao, Fei Luo, Jiongming Qin et al.
ICCV · Xinhang Liu, Jiawei Shi, Zheng Dang et al.
CVPR · Mengya Liu, Siyuan Li, Ajad Chhatkuli et al.
CVPR · Weijian Deng, Dylan Campbell, Chunyi Sun et al.
WACV · Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel et al.
ICCV · Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu et al.
WACV · Varun Burde, Assia Benbihi, Pavel Burget et al.
CVPR · Jaeguk Kim, Jaewoo Park, Keuntek Lee et al.
CVPR · Qingyuan Wang, Rui Song, Jiaojiao Li et al.
CVPR · Ming-Feng Li, Xin Yang, Fu-En Wang et al.
CVPR · Xingyu Liu, Gu Wang, Ruida Zhang et al.
IEEE TCSVT · Jianqiu Chen, Zikun Zhou, Mingshan Sun et al.
CVPR · Bowen Wen, Wei Yang, Jan Kautz et al.
ECCV · Evin Pınar Örnek, Yann Labbé, Bugra Tekin et al.
ECCV · Andrea Caraffa, Davide Boscaini, Amir Hamza et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann et al.
CVPR · Junwen Huang, Hao Yu, Kuan-Ting Yu et al.
CVPR · Yuelong Li, Yafei Mao, Raja Bala et al.
CVPR · Jaime Corsetti, Davide Boscaini, Changjae Oh et al.
ECCV · Yang You, Kai Xiong, Zhening Yang et al.
ECCV · Yangzheng Wu, Michael Greenspan
CVPR · Jiehong Lin, Lihua Liu, Dekun Lu et al.
CVPR · Tsu-Ching Hsiao, Hao-Wei Chen, Hsuan-Kung Yang et al.
ICRA · Philipp Ausserlechner, David Haberger, Stefan Thalhammer et al.
CoRL · Yann Labbé, Lucas Manuelli, Arsalan Mousavian et al.
CVPR · Gu Wang, Fabian Manhardt, Federico Tombari et al.
ECCV · Yann Labbé, Justin Carpentier, Mathieu Aubry et al.
CVPR · Tomas Hodan, Daniel Barath, Jiri Matas
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
2D Projection Error
Maximum Symmetry-Aware Surface Distance
BOP Average Recall
BOP Average Precision for 6D Detection