Strength
What it is useful for
- More closely reflects end-to-end use of real multi-object systems.
- Evaluates detection quality and pose quality within one protocol.
BOP / 6D detection aggregation · aggregate
BOP Average Precision for 6D Detection
Uses precision–recall curves to evaluate detection and pose jointly in 6D detection tasks where the objects present in the image are unknown.
Unlike localization AR, the model must both estimate poses correctly and suppress incorrect classes and duplicate detections. The current BOP detection evaluation is based on MSSD and MSPD.
Principle
The formulas define the computation. The diagrams show whether the error concerns a 3D model, visible surfaces, the image plane, or aggregation across thresholds.
Localization is given the object identities and mainly asks whether their poses are correct; detection must also find all objects without false positives.
AP therefore penalizes poor confidence ranking, missed detections, and duplicate predictions, making it generally stricter than AR.
How to compute
Output all candidates with object id, pose, and confidence.
Match predictions to ground truth in confidence order and use MSSD/MSPD to determine true positives.
Compute precision–recall curves and AP_e, then aggregate them into AP.
Strength
Caveat
Paper atlas
Links are derived by normalizing the metric names used in each paper. Directly reported metrics are distinguished from metrics associated through a broader protocol.
CVPR · Agastya Kalra, Tim Salzmann, Guy Stoppi et al.
ECCV · Junwen Huang, Jiaqi Hu, Peter KT Yu et al.
IEEE TCSVT · Jianqiu Chen, Zikun Zhou, Mingshan Sun et al.
CVPR · Jiehong Lin, Lihua Liu, Dekun Lu et al.
IROS · Ding-Tao Huang, En-Te Lin, Lipeng Chen et al.
Next
Compare metrics at the same level to understand why one score improves while another stays unchanged.
Maximum Symmetry-Aware Surface Distance
Maximum Symmetry-Aware Projection Distance
BOP Average Recall