Strength
What it is useful for
- Includes category-level size estimation in the same score.
- Easier to define than ADD when complete CAD meshes are unavailable.
9DoF / size and pose · error
3D Bounding-box Intersection over Union
Compares the overlap of predicted and ground-truth 3D bounding boxes, reflecting position, rotation, and size together.
3D IoU is common in category-level 9DoF pose evaluation: when a method also predicts object size, 6DoF pose alone is insufficient.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
Increasing error in position, orientation, or size reduces the intersection between the two boxes.
It therefore measures overlap of occupied volumes rather than precise CAD surface-point alignment.
How to compute
Construct the predicted 3D box from pose and size.
Construct the ground-truth 3D box.
Compute intersection and union volumes, then average over instances or apply thresholds for mAP.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Huan Ren, Yihan Chen, Chuxin Wang et al.
CVPR · Liming Kuang, Yordanka Velikova, Mahdi Saleh et al.
ICRA / IEEE RA-L · Xiangting Meng, Jiaqi Yang, Mingshu Chen et al.
ECCV · Xiao Lin, Minghao Zhu, Yun Peng et al.
IJCV · Jian Liu, Wei Sun, Hui Yang et al.
AAAI · Xianhui Meng, Yukang Huo, Li Zhang et al.
CVPR · Sheng Yu, Di-Hua Zhai, Yuanqing Xia
ICRA · Hakjin Lee, Junghoon Seo, Jaehoon Sim
3DV · Suhas Gopal, Rishabh Dabral, Vladislav Golyanik et al.
ICCV · Xiao Lin, Yun Peng, Liuyi Wang et al.
CVPR · Weihang Li, Hongli Xu, Junwen Huang et al.
CVPR · Junning Qiu, Minglei Lu, Fei Wang et al.
AAAI · Sheng Yu, Di-Hua Zhai, Yuanqing Xia
ICRA · Jian Liu, Wei Sun, Hui Yang et al.
AAAI · Li Zhang, Haonan Jiang, Yukang Huo et al.
CVPR · Huan Ren, Wenfei Yang, Shifeng Zhang et al.
ICCV · Tom Fischer, Xiaojie Zhang, Eddy Ilg
AAAI · Wentian Qu, Chenyu Meng, Heng Li et al.
ICRA · Jingshun Huang, Haitao Lin, Tianyu Wang et al.
CVPR · Xiao Lin, Wenfei Yang, Yuan Gao et al.
ECCV · Chuanrui Zhang, Yonggen Ling, Minglei Lu et al.
ICRA · Jiaxin Wei, Xibin Song, Weizhe Liu et al.
ICRA · Jia Li, Li Jin, Xibin Song et al.
CVPR · Linfang Zheng, Tze Ho Elden Tse, Chen Wang et al.
ECCV · Pengyuan Wang, Takuya Ikeda, Robert Lee et al.
CVPR · HyunJun Jung, Shun-Cheng Wu, Patrick Ruhkamp et al.
CVPR · Jingtao Sun, Yaonan Wang, Mingtao Feng et al.
ECCV · Ruida Zhang, Ziqin Huang, Gu Wang et al.
CVPR · Liyuan Zhu, Shengyu Huang, Konrad Schindler et al.
ECCV · Mengchen Zhang, Tong Wu, Tai Wang et al.
ECCV · Jiyao Zhang, Weiyao Huang, Bo Peng et al.
ECCV · Akshay Krishnan, Abhijit Kundu, Kevis-Kokitsi Maninis et al.
ECCV · Yang You, Kai Xiong, Zhening Yang et al.
CVPR · Yamei Chen, Yan Di, Guangyao Zhai et al.
ECCV · Li Zhang, Weiqing Meng, Yan Zhong et al.
ICRA · Muhammad Zubair Irshad, Thomas Kollar, Michael Laskey et al.
CVPR · He Wang, Srinath Sridhar, Jingwei Huang et al.
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Rotation–Translation Threshold Accuracy
3D Translation Error
Bidirectional Chamfer Distance