Strength
What it is useful for
- Directly reflects application tolerances.
- Independent of CAD surface sampling and suitable for category-level scale and pose tasks.
6DoF / threshold accuracy · threshold
Rotation–Translation Threshold Accuracy
Counts a pose as correct only when both rotation and translation errors fall below their thresholds.
Examples include 5° 2cm, 5° 5cm, and 10° 5cm. Common in category-level and 9DoF papers, but results at different thresholds are not directly comparable.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
Converts continuous errors into a binary decision about whether the required precision is met.
The joint criterion prevents a correct rotation alone, or a correct position alone, from being counted as a successful pose.
How to compute
Compute rotation and translation errors for each instance.
Determine success using the n° and mcm thresholds specified by the paper or dataset.
Compute the success fraction over all instances; report each threshold in a separate column when using multiple thresholds.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Huan Ren, Yihan Chen, Chuxin Wang et al.
ECCV · Xiao Lin, Minghao Zhu, Yun Peng et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
CVPR · Jingshun Huang, Haitao Lin, Tianyu Wang et al.
ICCV · Xiao Lin, Yun Peng, Liuyi Wang et al.
CVPR · Weihang Li, Hongli Xu, Junwen Huang et al.
WACV · Yujing Sun, Caiyi Sun, Yuan Liu et al.
CVPR · Ziqin Huang, Gu Wang, Chenyangguang Zhang et al.
CVPR · Junning Qiu, Minglei Lu, Fei Wang et al.
AAAI · Sheng Yu, Di-Hua Zhai, Yuanqing Xia
IROS · Yifan Yang, Peili Song, Enfan Lan et al.
IROS · Sheng Yu, Di-Hua Zhai, Yuanqing Xia
CVPR · Huan Ren, Wenfei Yang, Shifeng Zhang et al.
AAAI · Wentian Qu, Chenyu Meng, Heng Li et al.
CVPR · Xiao Lin, Wenfei Yang, Yuan Gao et al.
IROS · Takuya Ikeda, Sergey Zakharov, Tianyi Ko et al.
ICRA · Jiaxin Wei, Xibin Song, Weizhe Liu et al.
ICRA · Jia Li, Li Jin, Xibin Song et al.
AAAI · JongMin Lee, Yohann Cabon, Romain Brégier et al.
IROS · Jiaqi Yang, Yucong Chen, Xiangting Meng et al.
ICRA · Ronghan Chen, Yang Cong, Yu Ren
IROS · Francesco Milano, Jen Jen Chung, Hermann Blum et al.
ECCV · Yuchen Che, Ryo Furukawa, Asako Kanezaki
WACV · Jiahao Yang, Wufei Ma, Angtian Wang et al.
IROS · Kun Qian, Mustafa Suphi Erden, Xianwen Kong
IROS · Lun Li, Hamidreza Kasaei
IROS · Yunlong Wang, Lei Zhang, Yuyang Tu et al.
IROS · Francesco Di Felice, Alberto Remus, Stefano Gasperini et al.
ICRA · Muhammad Zubair Irshad, Thomas Kollar, Michael Laskey et al.
CoRL · Yann Labbé, Lucas Manuelli, Arsalan Mousavian et al.
3DV · Van Nguyen Nguyen, Yuming Du, Yang Xiao et al.
CVPR · He Wang, Srinath Sridhar, Jingwei Huang et al.
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Geodesic Rotation Error
3D Translation Error
3D Bounding-box Intersection over Union