Strength
What it is useful for
- Handles model symmetry explicitly and reproducibly.
- Meaningful for clearance, insertion, and grasping tasks that cannot tolerate large local errors.
BOP / 3D surface error · error
Maximum Symmetry-Aware Surface Distance
Minimizes the maximum 3D surface deviation over all allowed global symmetry transformations.
MSSD is sensitive to the worst-aligned point and explicitly uses the model's symmetry set. It emphasizes 3D geometric precision and is often used in strict evaluations related to robotic manipulation.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
First try alignment under all allowed symmetry transformations S to avoid penalizing equivalent poses.
Then measure the displacement of the worst-aligned model vertex, so large local errors cannot be diluted by averaging.
How to compute
Read discrete and continuous symmetry definitions from BOP models_info.json.
For each symmetry transformation, compute the maximum distance over all model vertices.
Take the minimum over symmetry candidates, then compute recall using BOP thresholds.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Anna Šárová Mikeštíková, Médéric Fourmy, Martin Cifka et al.
CVPR · Yuchen Che, Jingtu Wu, Hao Zheng et al.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
AAAI · Dexin Zuo, Ang Li, Wei Wang et al.
3DV · Sebastian Jung, Leonard Klüpfel, Rudolph Triebel et al.
arXiv · Jongbin Lim, Taeyun Ha, Mingi Choi et al.
ICRA · Panagiotis Sapoutzoglou, Orestis Vaggelis, Athina Zacharia et al.
ICRA / IEEE RA-L · Francesco Di Felice, Alberto Remus, Stefano Gasperini et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
CVPR · Jianqi Chen, Biao Zhang, Xiangjun Tang et al.
CVPR · Wubin Shi, Shaoyan Gai, Feipeng Da
WACV · Sajjad Pakdamansavoji, Yintao Ma, Amir Rasouli et al.
ECCV · Junwen Huang, Jiaqi Hu, Peter KT Yu et al.
CVPR · Taeyeop Lee, Bowen Wen, Minjun Kang et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Tuo Cao, Fei Luo, Jiongming Qin et al.
IROS · Sai Srinivas Jeevanandam, Sandeep Inuganti, Shreedhar Govil et al.
ICCV · Xinhang Liu, Jiawei Shi, Zheng Dang et al.
CVPR · Mengya Liu, Siyuan Li, Ajad Chhatkuli et al.
CVPR · Weijian Deng, Dylan Campbell, Chunyi Sun et al.
WACV · Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel et al.
ICCV · Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu et al.
WACV · Varun Burde, Assia Benbihi, Pavel Burget et al.
CVPR · Jaeguk Kim, Jaewoo Park, Keuntek Lee et al.
CVPR · Qingyuan Wang, Rui Song, Jiaojiao Li et al.
CVPR · Ming-Feng Li, Xin Yang, Fu-En Wang et al.
CVPR · Xingyu Liu, Gu Wang, Ruida Zhang et al.
IEEE TCSVT · Jianqiu Chen, Zikun Zhou, Mingshan Sun et al.
CVPR · Bowen Wen, Wei Yang, Jan Kautz et al.
ECCV · Evin Pınar Örnek, Yann Labbé, Bugra Tekin et al.
ECCV · Andrea Caraffa, Davide Boscaini, Amir Hamza et al.
CVPR · Sungphill Moon, Hyeontae Son, Dongcheol Hur et al.
CVPR · Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann et al.
CVPR · Junwen Huang, Hao Yu, Kuan-Ting Yu et al.
CVPR · Yuelong Li, Yafei Mao, Raja Bala et al.
CVPR · Jaime Corsetti, Davide Boscaini, Changjae Oh et al.
ECCV · Yang You, Kai Xiong, Zhening Yang et al.
ECCV · Yangzheng Wu, Michael Greenspan
CVPR · Jiehong Lin, Lihua Liu, Dekun Lu et al.
CVPR · Tsu-Ching Hsiao, Hao-Wei Chen, Hsuan-Kung Yang et al.
ICRA · Philipp Ausserlechner, David Haberger, Stefan Thalhammer et al.
CoRL · Yann Labbé, Lucas Manuelli, Arsalan Mousavian et al.
CVPR · Gu Wang, Fabian Manhardt, Federico Tombari et al.
ECCV · Yann Labbé, Justin Carpentier, Mathieu Aubry et al.
CVPR · Tomas Hodan, Daniel Barath, Jiri Matas
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Visible Surface Discrepancy
Maximum Symmetry-Aware Projection Distance
BOP Average Recall
BOP Average Precision for 6D Detection