Strength
What it is useful for
- Reduces rankings that depend on an arbitrary threshold choice.
- Can show both overall accuracy and performance in the low-error region.
6DoF / threshold aggregation · aggregate
Area Under the ADD Recall Curve
Averages recall over a range of error thresholds instead of relying on a single threshold.
AUC integrates the curve of success rate versus error threshold. It is more continuous than ADD-0.1d, but the upper limit can substantially change the score.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
Each threshold θ corresponds to the fraction of instances with error below θ.
AUC averages over θ, distinguishing models near a threshold more effectively than a single threshold score.
How to compute
Collect the ADD or ADD-S error for every instance.
Compute recall at multiple thresholds between 0 and e_max.
Integrate numerically and normalize by e_max.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
AAAI · Dexin Zuo, Ang Li, Wei Wang et al.
CVPR · Nassim Ali Ousalah, Peyman Rostami, Vincent Gaudillière et al.
CVPR · Taegyoon Yoon, Yegyu Han, Seojin Ji et al.
ECCV · Hui Yang, Wei Sun, Jian Liu et al.
ICRA / IEEE RA-L · Seunghyeok Back, Joosoon Lee, Kangmin Kim et al.
ICRA / IEEE RA-L · Yibo Liu, Zhaodong Jiang, Binbin Xu et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
ECCV · Hongli Xu, Jiaqi Hu, Junwen Huang et al.
ECCV · Tzu-Yuan Lin, Ho Jae Lee, Kevin Doherty et al.
CVPR · Taeyeop Lee, Bowen Wen, Minjun Kang et al.
ICCV · Yuanhong Yu, Xingyi He, Chen Zhao et al.
CVPR · Jingnan Shi, Rajat Talak, Harry Zhang et al.
IROS · Tingbang Liang, Yixin Zeng, Jiatong Xie et al.
ICRA · Jingyang Liu, Zhenyu Lu, Lu Chen et al.
CVPR · Tao Tan, Qiulei Dong
CVPR · Mengya Liu, Siyuan Li, Ajad Chhatkuli et al.
CVPR · Qingyuan Wang, Rui Song, Jiaojiao Li et al.
CVPR · Ming-Feng Li, Xin Yang, Fu-En Wang et al.
ICRA · Hongyu Li, James Akl, Srinath Sridhar et al.
CVPR · Li Xu, Haoxuan Qu, Yujun Cai et al.
CVPR · Bowen Wen, Wei Yang, Jan Kautz et al.
WACV · Yangzheng Wu, Michael Greenspan
WACV · Janis Rosskamp, Rene Weller, Gabriel Zachmann
ICRA · Arul Selvam Periyasamy, Sven Behnke
ECCV · Yang You, Kai Xiong, Zhening Yang et al.
ECCV · Yangzheng Wu, Michael Greenspan
3DV · Debapriya Maji, Soyeb N. Nagori, Manu Mathew et al.
ECCV · Yuan Liu, Yilin Wen, Sida Peng et al.
3DV · Van Nguyen Nguyen, Yuming Du, Yang Xiao et al.
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Average Distance of Model Points
Average Closest Point Distance
Symmetry-dependent ADD Reporting Protocol