Strength
What it is useful for
- Convenient for reporting one overall score on historical benchmarks.
- Avoids applying inappropriate ADD errors to clearly symmetric objects.
6DoF / reporting protocol · protocol
Symmetry-dependent ADD Reporting Protocol
Selects ADD or ADD-S according to object symmetry, then aggregates the results into one score.
A dataset-level reporting rule, not a new distance formula. Papers use ADD(S), ADD(-S), and ADD(S)-0.1d in different ways; consult the benchmark definition.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
Fix the rule for each object: ADD for asymmetric objects and ADD-S for symmetric objects.
Then average over objects or instances, so the overall score combines two error functions.
How to compute
Read object symmetries from the benchmark definition.
Compute ADD for asymmetric objects and ADD-S for symmetric objects.
Convert the selected errors to success rates or curves, then aggregate according to the protocol.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
AAAI · Dexin Zuo, Ang Li, Wei Wang et al.
CVPR · Nassim Ali Ousalah, Peyman Rostami, Vincent Gaudillière et al.
CVPR · Taegyoon Yoon, Yegyu Han, Seojin Ji et al.
CVPR · Jae-Young Kang, Hoonhee Cho, Taeyeop Lee et al.
ICRA / IEEE RA-L · Seunghyeok Back, Joosoon Lee, Kangmin Kim et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
CVPR · Yating Liu, Zhaoshuai Qi, Yang Zou et al.
CVPR · Wubin Shi, Shaoyan Gai, Feipeng Da
ICCV · Yuanhong Yu, Xingyi He, Chen Zhao et al.
ICCV · Jinghao Wang, Zhang Li, Zi Wang et al.
ICCV · Shaobo Zhang, Yuhang Huang, Wanqing Zhao et al.
3DV · Dingding Cai, Janne Heikkilä, Esa Rahtu
CVPR · Tuo Cao, Fei Luo, Jiongming Qin et al.
ICRA · Jingyang Liu, Zhenyu Lu, Lu Chen et al.
CVPR · Tao Tan, Qiulei Dong
ICCV · Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu et al.
CVPR · Qingyuan Wang, Rui Song, Jiaojiao Li et al.
IROS · Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel et al.
IROS · Ruyi Lian, Yuewei Lin, Longin Jan Latecki et al.
ICRA · Jianqiu Chen, Zikun Zhou, Xin Li et al.
CVPR · Li Xu, Haoxuan Qu, Yujun Cai et al.
3DV · Panwang Pan, Zhiwen Fan, Brandon Yushan Feng et al.
CVPR · Yongliang Lin, Yongzhi Su, Praveen Nathan et al.
WACV · Yangzheng Wu, Michael Greenspan
WACV · Janis Rosskamp, Rene Weller, Gabriel Zachmann
AAAI · JongMin Lee, Yohann Cabon, Romain Brégier et al.
ICRA · Arul Selvam Periyasamy, Sven Behnke
CVPR · Yuelong Li, Yafei Mao, Raja Bala et al.
IROS · Francesco Milano, Jen Jen Chung, Hermann Blum et al.
CVPR · Jaime Corsetti, Davide Boscaini, Changjae Oh et al.
ECCV · Yangzheng Wu, Michael Greenspan
CVPR · Jiehong Lin, Lihua Liu, Dekun Lu et al.
IROS · Kun Qian, Mustafa Suphi Erden, Xianwen Kong
3DV · Debapriya Maji, Soyeb N. Nagori, Manu Mathew et al.
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Average Distance of Model Points
Average Closest Point Distance
Area Under the ADD Recall Curve