← Back to the knowledge system
12 Symmetry Group Quotient Pose Multimodality Calibration

Symmetry, Ambiguity & Uncertainty

Why Can One Observation Have
Several Correct Poses?

A symmetric object's pose is an equivalence class under a proper symmetry group, rather than one arbitrary matrix. Occlusion, projection, and sensor failures add alternatives beyond global object symmetry. Separate these sources before choosing losses, distributions, confidence, and robot actions.

01 · Problem Contract

Define equivalent poses before training or evaluation

Symmetry is not a constant derived solely from shape. Instances, modalities, task costs, and evaluation tolerances change equivalence relations; give each layer independent fields and versions.

01

Object

Metric meshes, part identities, proper groups, axes/offsets, instance differences

→
02

Appearance

Whether texture, text, materials, spectrum, and illumination break geometric symmetry

→
03

Observation

Modes supported by visible surfaces, occlusion, projection, noise, and modality validity

→
04

Task

Pose changes with equal grasping, insertion, placement, or control costs

→
05

Protocol

Losses, metrics, correctness thresholds, confidence, calibration splits

Scope of This Topic This topic defines equivalent poses, multimodal posteriors, and calibration contracts. Topic 13 details ADD(-S), VSD, MSSD, MSPD, BOP Average Recall, matching, and aggregation. Every result needs symmetry rules, thresholds, and implementation versions.

02 · Five Distinct Layers

Geometry, appearance, observations, tasks, and representations define different equivalences

Calling every pair of plausible poses symmetric is a common error. These five layers differ in scope, evidence, and handling.

01

Geometric symmetry

Question
Which proper rigid motions preserve surfaces, part identities, and scale?
Scope
Object-level and view-independent; usually defined by CAD/scans and object semantics
Example
C₄ for a textureless square prism, axial SO(2) for a cylinder, SO(3) for an ideal sphere
Handling
Store symmetry metadata; train, match, and evaluate in the quotient space
02

Appearance symmetry

Question
Which changes preserve the observable object after considering texture, text, color, and material?
Scope
Depends on sensor spectrum and illumination; can be smaller than the geometric group
Example
A one-sided label usually reduces a geometric C₄ box to identity in visible light
Handling
Specify geometry-only or appearance-aware symmetry; automatic mesh analysis must not overwrite semantic definitions
03

Visible / observational ambiguity

Question
Which poses explain the current image, occlusion, projection, and noise?
Scope
Sample-level and view-dependent; not necessarily global object symmetry
Example
A hidden mug handle permits a 180° flip; frontal silhouettes can yield two solutions
Handling
Use multimodal posteriors, tracking, active views, or abstention; keep this out of global object metadata
04

Task equivalence

Question
Which visually distinct poses have equal cost for grasping, insertion, placement, or avoidance?
Scope
Defined jointly by actions, end effectors, contact, and safety constraints
Example
Any disc yaw may suit suction grasping, while a keyed assembly needs unique yaw
Handling
Merge or separate modes in downstream costs without rewriting perceptual facts
05

Representation equivalence

Question
Does one rotation have multiple numerical parameterizations?
Scope
Representation-level; independent of object shape
Example
Unit quaternions q and −q always represent one SO(3) element
Handling
Handle antipodal equivalence in quaternion losses/interpolation separately from object symmetry
Reflections are not ordinary 6D rotational symmetries SO(3) contains proper rotations with det(R)=+1. Reflections, mirrored instances, and handedness changes are improper O(3) transforms; matching silhouettes do not justify right-multiplying them into poses. Use instance/category semantics, shape correspondences, or a separate mirror variable.

03 · Pose as an Equivalence Class

A symmetric object's state lies in SE(3) / 𝒮, beyond one canonical matrix

Even after fixing the object frame, multiple object-to-camera transforms may align every semantically labeled surface. They are representatives of one pose.

Proper object symmetry group
SO={S=(RS,tS)∈SE(3) | S(M)=M},RS⊤RS=I, det⁡RS=+1\mathcal S_O=\left\{S=(R_S,t_S)\in SE(3)\ \middle|\ S(\mathcal M)=\mathcal M\right\},\qquad R_S^\top R_S=I,\ \det R_S=+1
𝓜 can include parts, texture, or task semantics alongside unlabeled points. Choosing invariant attributes chooses the symmetry group.
Equivalent pose orbit
[T]=TSO={TS∣S∈SO},PO≅SE(3)/SO[T]=T\mathcal S_O=\left\{TS\mid S\in\mathcal S_O\right\},\qquad \mathcal P_O \cong SE(3)/\mathcal S_O
This site maps object points into the camera with ᶜTₒ. Right-multiplying S selects an equivalent object-internal representative before applying the external pose.
Distance between quotient poses
dP ⁣([T1],[T2])=min⁡S1,S2∈SOdSE(3)(T1S1,T2S2) ≡ min⁡S∈SOdSE(3)(T1,T2S)d_{\mathcal P}\!\left([T_1],[T_2]\right)=\min_{S_1,S_2\in\mathcal S_O}d_{SE(3)}(T_1S_1,T_2S_2)\ \equiv\ \min_{S\in\mathcal S_O}d_{SE(3)}(T_1,T_2S)
The right-hand equivalent form requires suitable invariance of the base distance. Rotation geodesics, surfaces, projections, and task costs answer different questions.
Representative

One matrix is an interface choice

A numeric label can select a canonical representative without making it truer than other orbit elements. Output the symmetry rule/object version with it.

Canonical section

Global canonical choices usually have boundaries

Mapping C₄ yaw to [−45°,45°) jumps at ±45°. Tiny input changes can demand labels separated by 90°.

Gauge

Continuous symmetric directions cannot be recovered without evidence

An ideal cylinder's axial yaw is gauge. Choosing yaw=0 is a convention; low variance without identifying cues expresses false certainty.

Double cover

q and −q describe parameterization, not the object orbit

Quaternions lie on S³ and map 2-to-1 to SO(3). Handle antipodal equivalence before adding object-specific symmetry.

04 · Symmetry Groups & Metadata

From Cₙ to continuous axes: store full rigid actions, beyond angles

Discrete, continuous, and approximate symmetries require different numerical handling. An off-origin symmetry axis necessarily couples rotation and translation.

FamilyStructurePose orbitEngineering notes
Trivial {I}Asymmetric objectsOne local representativeOcclusion, projection, or weak evidence can still create observational alternatives
Cₙn discrete rotations around one axisn representativesGears, square prisms; appearance or tasks may reduce n
Dₙ proper partn principal-axis rotations + n perpendicular half-turns2n proper rotationsDo not insert planar reflection matrices directly into SO(3)
T / O / IRegular tetrahedron, cube/octahedron, icosahedron/dodecahedron12 / 24 / 60 proper rotationsFinite noncommutative groups, beyond one yaw period
SO(2)Continuous rotation around a fixed object axisOne continuous orbitAxial surfaces of revolution; rotation about the axis is gauge
SO(3)Ideal spheres or fully isotropic tasksFull rotation orbitRotation is unidentifiable, while position may remain meaningful
Approximate / partial symmetryTransformed surfaces are close but not identicalDepends on tolerance and observation resolutionState tolerance, sensor, and task; do not claim an exact group
Rotation about an offset axis
x′=R(x−o)+o=Rx+(I−R)o,S=[R(I−R)o01]x'=R(x-o)+o=Rx+(I-R)o,\qquad S=\begin{bmatrix}R&(I-R)o\\0&1\end{bmatrix}
o is any object-frame point on the axis. If the origin is off-axis, t=(I−R)o is essential.

05 · Observation-Conditioned Ambiguity

An asymmetric object can still be unidentifiable in one frame

Identifiability depends on the observation model and evidence. More similarly distributed training data cannot recover information hidden by occlusion, projection collapse, or sensor loss.

Observation equivalence set
A(x;ϵ)={T∈SE(3) | D ⁣(h(T,η),x)≤ϵ for some nuisance η}\mathcal A(x;\epsilon)=\left\{T\in SE(3)\ \middle|\ D\!\left(h(T,\eta),x\right)\le\epsilon\ \text{for some nuisance }\eta\right\}
h is the imaging/sensor model; η includes lighting, occlusion, and noise. The global symmetry orbit remains in the ideal observational equivalence set; additional modes may exist only for the current x.
SourceWhy alternatives ariseDiagnostic evidenceHandling
Self-occlusion / external occlusionHidden asymmetric parts let different poses render the same visible regionVisible masks, amodal support, intermode render residualsChange views, retain modes across frames, output top-K
Projection and silhouettes3D differences collapse along viewing rays; frontal, weak-perspective, or nearly planar structures yield alternativesMultiview baseline, depth/normals, oblique silhouettesAdd oblique views, metric depth, or structural priors
Repeated parts / local patchesLocal descriptors match multiple locations in periodic structuresCorrespondence-vote mode counts, part identityGroup-aware matching, global verification, multimodel RANSAC
Weak texture / lighting changesBlur, overexposure, shadows, or low resolution remove unique appearance cuescue visibility, MTF / exposure, appearance ablationImprove capture or explicitly use a geometric subgroup
Mirrors / transparency / depth holesMismatched observation models make intensity/depth unreliable surface evidencesensor confidence, multi-view consistency, OOD scoreSensor fallback, polarization/touch/silhouettes, rejection
Cropping / truncationKey parts leave the image; scale and center compensate for one anotherFull bboxes, truncation, proposal-boundary stress testsWiden ROIs, use full-image context, multiple frames, or active fallback
Category and instance variationCanonical frames, proportions, or local structures differ across instancesinstance metadata, shape posterior, scale residualJoint shape–scale–pose distributions; label disagreement is not simply noise
Annotation / canonical conflictsAnnotators or datasets choose different orbit representativesquotient-aware inter-annotator distanceSave equivalence sets/rule versions and marginalize during training
Global?

The whole object and all required attributes remain invariant

Yes → quotient pose; new views cannot break true symmetry.

→
Visible?

Is the current asymmetric cue observed validly?

No → view-induced modes; inspect occlusion, truncation, and validity.

→
Separating evidence?

Do expected intermode observation differences exceed noise?

No → retain the posterior; avoid forcing an average pose.

→
Action?

Do modes still have different task costs?

Different → acquire / top-K / abstain; equal → action quotient.

06 · Supervision, Loss & Matching

Supervise equivalence sets instead of the annotator's arbitrary representative

Parameter regression, surface matching, correspondences, and probability densities must specify finite/continuous groups, visible ambiguity, and representation double cover.

Finite-group symmetry-aware rotation loss
LR(R^,R⋆)=min⁡S∈SR∥log⁡ ⁣((R⋆S)⊤R^)∥2\mathcal L_R(\hat R,R^\star)=\min_{S\in\mathcal S_R}\left\|\log\!\left((R^\star S)^\top\hat R\right)\right\|_2
This is rotational geodesic min-over-group. Offset translations in S also require translation coupling in full SE(3)/surface losses.
Marginal likelihood over equivalent truth
LNLL=−log⁡p([T⋆]∣x)=−log⁡ ⁣(∑S∈SOp(T⋆S∣x))\mathcal L_{\mathrm{NLL}}=-\log p([T^\star]\mid x)=-\log\!\left(\sum_{S\in\mathcal S_O}p(T^\star S\mid x)\right)
Finite groups use sums; continuous groups require integration or quotient-space density. Measures and normalization are essential.
Parameter regression + min-over-group

Matrices, quaternions, continuous 6D rotations, or se(3) residuals

Minimize geodesic / parameter-consistent losses over finite symmetry representatives

Strength
Simple and compatible with existing regressors
Trap
Discontinuous canonical-cell boundaries; Euclidean parameter distance may differ from surface/task distance
Surface matching / ADD-S style

Transformed model point sets

Compare nearest surfaces or apply explicit symmetry transforms first

Strength
Directly reflects model geometry and scale
Trap
Nearest points may overaccept repeated local structure; density and invisible surfaces affect results
Symmetry-aware correspondence

2D–3D / 3D–3D correspondences, object coordinates, or keypoints

Treat equivalent surface points as one target set, or predict fragments/regions before composition

Strength
Avoid contradictory canonical labels upstream
Trap
Conflating global symmetry with view-induced ambiguity in correspondence sets
Likelihood marginalization

p(T|x), or discrete / continuous pose densities

Sum or integrate over equivalent ground truth rather than rewarding one representative

Strength
Preserves modes and probability mass for NLL and decisions
Trap
Coarse continuous-group discretization; unspecified base measure / normalization
Multiple-choice / best-of-M

M pose hypotheses + scores

Cover the ground-truth orbit with at least one hypothesis; train mode scores/diversity

Strength
Easy integration with PnP, tracking, and verification
Trap
Oracle best-of-M alone hides unusable scores, collapsed modes, and K-dependent cost
Task-aware expected risk

Action, grasp, or control outcomes

Expected downstream costs, worst-case modes, or chance constraints under the posterior

Strength
Aligns visual uncertainty with actual failure costs
Trap
Task equivalence does not replace general pose reporting; wrong costs can create false safety
A minimum can also hide failures Min-over-group handles known equivalent truth, not incorrect metadata, new occlusion modes, ranking, or collapse. Oracle-only best-of-K training can always contain a close candidate while consistently selecting the wrong one in deployment.

07 · Interactive Lab

Distinguish equivalent orbits, view-induced modes, and false confidence

The first experiment changes geometric/appearance/task equivalence. The second creates modes through occlusion of an asymmetric object. The third compares top-K, NLL, entropy, epistemic signals, and calibration.

Interactive · Quotient Pose, Ambiguity & Calibration

Equivalent Poses, Visible Ambiguity, and Multimodal Confidence Lab

Compute pose orbits under object, appearance, and task equivalence; see how occlusion creates nonglobal alternatives; then compare point estimates with full distributions. Yaw slices illustrate the concepts; the text defines full SO(3) / SE(3) conventions.
pose = equivalence class ambiguity can be multimodal score ≠ probability
ground-truth representative equivalent orbit estimate One physical state can have multiple transform representatives

Symmetry group

—

—Proper rotations only; mirrored shapes are not automatically equivalent 6D poses

Naïve angle error

|wrap(ŷ − y)|

—Single-representative error ignoring object equivalence

Quotient-pose error

min over symmetry orbit

——

Equivalence verdict

—

——

Canonicalization risk

—

—Canonical representatives are interface choices, not added observations
Quaternions q and −q do not describe object symmetry. They form the quaternion double cover of SO(3): every object and rotation has both numerical representatives. Object C₂, C₄, and continuous axial symmetries come from proper object groups. Handle these separately in losses, interpolation, deduplication, and annotation.

08 · Pose Distributions

Point estimates, local covariances, and multimodal posteriors have different capacities

Choose distributions/interfaces after distinguishing small unimodal errors, finite separated modes, and continuous symmetry orbits.

Local SE(3) perturbation contract
T=Exp⁡(ξ^)Tˉ (left)orT=TˉExp⁡(ξ^) (right),ξ∼N(0,Σ6×6)T=\operatorname{Exp}(\hat\xi)\bar T\ \text{(left)}\quad\text{or}\quad T=\bar T\operatorname{Exp}(\hat\xi)\ \text{(right)},\qquad \xi\sim\mathcal N(0,\Sigma_{6\times6})
Σ requires a tangent point, left/right convention, and frame; record meter/radian scaling. Distant modes need mixtures rather than one enlarged ellipsoid.
OutputRepresentationSuitable useLimits
Point + scoreOne transform and a potentially unnormalized scoreLow latency and simple interfacesCannot express distant modes; scores are not inherently success probabilities
Top-K hypothesesK transforms, weights, and equivalence deduplication rulesSuitable for PnP / templates / tracking / verificationReport K, coverage, ranking, and downstream costs
Local mean + 6×6 covarianceA local ellipsoid with specified left/right perturbations, frame, and tangent pointUnimodal small errors, filtering, optimizationCannot span distant symmetry modes; scale rotation/translation units appropriately
Bingham on S³antipodal-symmetric quaternion orientation distributionRespects q/−q and models directional axes/anisotropyOne Bingham does not represent an arbitrary multimodal SE(3) posterior
Matrix Fisher on SO(3)Exponential family defined directly on rotation matricesNo coordinate singularities; structured local uncertaintyA finite parameter family cannot represent every complex/continuous multimodal density
Mixture / particlesMultiple local distributions or weighted samplesExplicitly retains symmetry, occlusion, and association modesProtocols must specify component alignment, deduplication, normalization, and compute budgets
Implicit density / flowQueryable relative / normalized density for any R or TArbitrary SO(3) modes and higher-order structureMore complex sampling, normalization, training measures, and calibration
Aleatoric / data uncertainty

Noise or irreducible ambiguity under a given observation mechanism

Conditional spread for occluded, blurred, or weak-return samples under one model

Additional views/better sensors may reduce it; retraining alone may not
Epistemic / model uncertainty

Unknowns from missing training coverage, parameters, or model families

ensemble / posterior disagreement, density support, OOD stress test

Add relevant data/models/priors; one softmax entropy does not identify this alone
Symmetry multiplicity

Several numerical representatives of one physical pose

Object symmetry group and quotient orbit

Merge into equivalence classes instead of counting as task risk/error
Observation ambiguity

Current evidence supports physically distinct quotient poses

Multiview / modality likelihoods and mode separability

Propagate modes, sense actively, or reject; avoid Euclidean averaging
Label / convention uncertainty

Inconsistent frames, units, timing, or canonical choices

annotation provenance, round trip, inter-annotator quotient distance

Fix data contracts rather than teaching models to absorb the error
Downstream risk

Failure probability induced jointly by posterior and action cost

expected cost, chance constraint, collision / grasp simulation

Can disagree with pose entropy; compute for the specific task

09 · Confidence & Calibration

Define correctness before judging probability reliability

Pose scores, detector scores, render residuals, densities, and robot success probabilities are distinct. Bind calibration to symmetry-aware events, domains, and versions.

Reliability and expected calibration error
acc⁡(Bm)=1∣Bm∣∑i∈Bm1[Ei],conf⁡(Bm)=1∣Bm∣∑i∈Bmp^i,ECE⁡=∑m∣Bm∣n∣acc⁡(Bm)−conf⁡(Bm)∣\operatorname{acc}(B_m)=\frac1{|B_m|}\sum_{i\in B_m}\mathbf1[E_i],\quad \operatorname{conf}(B_m)=\frac1{|B_m|}\sum_{i\in B_m}\hat p_i,\quad \operatorname{ECE}=\sum_m\frac{|B_m|}{n}\left|\operatorname{acc}(B_m)-\operatorname{conf}(B_m)\right|
Define Eᵢ, for example: at least one predicted pose satisfies MSSD<τ under object symmetry. Changing τ, K, metric, instance group, or task changes the event.
ToolMeasurement / procedureReporting and limits
Correctness eventDefine a symmetry-aware threshold event, such as MSSD<τ, task success, or top-K orbit coverageDifferent events need separate calibration; one confidence cannot support every claim
Reliability diagram / ECEBin confidence and compare empirical correctness; ECE is a weighted bin gapReport bins, counts, and class/visibility strata; one ECE hides local miscalibration
NLL / proper scoringRewards probability assigned to the correct equivalence set and penalizes false confidenceSum finite groups; continuous groups need a relative measure/tolerance or quotient density
Brier scoreCompare probability with outcome for an explicit binary success eventReveals overconfidence beyond accuracy, but still depends on the event definition
Coverage / set sizeDoes a prediction set / top-K contain equivalent ground truth, and how large is it?Report coverage with K, angular/surface thresholds, and symmetry rules
Risk–coverage / selective poseReject low-confidence samples and plot retained coverage versus riskChoose deployment thresholds by failure cost and capacity, beyond the most attractive operating point
Temperature scalingScale logits on validation data, usually preserving rankingCan reduce global over/underconfidence, but cannot create missing modes or fix OOD/symmetry metadata
Shift / OOD auditRetest calibration by instance, scene, occlusion, sensor, and timeIn-distribution calibration does not guarantee deployment reliability; version it and trigger fallback

Every Deployed Confidence Field Should Carry

target eventmetric + thresholdsymmetry versionK / set rule calibration splitdomain / sensorcalibrator versionvalidity / OOD flags

10 · Temporal Inference & Robotics

Time resolves view ambiguity without creating globally erased information

Track in quotient space while retaining necessary mode identity. Robot decisions then merge, verify, or reject modes using contact, collision, reachability, and safety costs.

01

Orbit-aware association

Gate using the minimum distance from track predictions to equivalent representatives, avoiding false jumps for one physical pose.

02

Symmetry unwrapping

For continuous display/control, select the representative nearest the previous state while retaining quotient pose. Unwrapping chooses temporal gauge, not recovered truth.

03

Mode persistence

Under occlusion, preserve weighted modes rather than resetting to an average pose; merge/prune when identifying cues return.

04

Motion can break ambiguity

Motion supplies parallax/new surfaces to resolve view-induced modes, but cannot break true global geometric-plus-appearance symmetry.

05

Filter manifold contract

EKF / factor-graph tangent covariances need left/right perturbations, reference frames, rotation/translation scaling, and relinearization rules.

06

Data association uncertainty

Identity, pose modes, and occlusion are coupled; fixing the wrong identity before pose filtering produces confident wrong tracks.

TaskVisual factsTask equivalenceDecision interface
Parallel-jaw graspingThe object may have C₄ symmetryJaw contacts are usually equivalent only under 180°; collisions/cables may break that equivalenceMap pose modes to grasp sets and merge action-equivalent modes by collision/force closure
Suction grasping a discContinuous unidentifiability of yaw about the normalCentral suction is approximately insensitive to yawEstimate position and surface normal, declare yaw gauge, and avoid fabricated angular precision
Insertion / assemblyApproximately axially symmetric housingNotches, keys, or pins make final roll unique with tight tolerancesTask symmetry is smaller than visual geometry; inspect key features actively or search by touch
Placement / orientationMultiple poses explain the current RGB-DCenters of mass, supports, labels, and reachability induce different costsEvaluate stable placement / reachability per mode; output expected risk and safe fallback
Visual servoingCanonical representatives can jump across cellsControllers need continuous errors; jumps can trigger large actionsCompute quotient-space errors and unwrap temporally; include velocity limits and mode switching in the state machine
Active sensingTwo modes differ only in handle visibilityReduce collision / grasp risk within limited timeChoose reachable, collision-free views maximizing expected intermode observation differences, beyond visible-pixel count
Posterior-aware robot decision
a⋆=arg⁡min⁡a∈A E[T]∼p([T]∣x) ⁣[C(a,[T])]subject toPr⁡ ⁣(Cunsafe(a,[T])>0)≤δa^\star=\arg\min_{a\in\mathcal A}\ \mathbb E_{[T]\sim p([T]\mid x)}\!\left[C(a,[T])\right]\qquad\text{subject to}\qquad \Pr\!\left(C_{\mathrm{unsafe}}(a,[T])>0\right)\le\delta
Perception expresses a posterior in object quotient space; action costs determine further mode equivalence. Safety-sensitive tasks can use chance constraints, worst-case modes, or active observations.

11 · Failure Modes & Release Gates

Do not disguise multiple solutions as one confident answer

These checks cover group validity, metadata, canonical discontinuities, distributions, confidence semantics, and leakage.

Failure modesSymptomsDetectionFix
Treating q/−q as object symmetryArtificial bimodal labels or quaternion-loss jumps for arbitrary objectsCheck R(q)=R(−q), then audit object symmetry separatelyUse |qᵀq̂| or rotation geodesics for the double cover
Encoding reflections as rotationsdet(R)=−1 and flipped handedness; meshes may overlap but the transform is outside SO(3)Assert RᵀR=I and det(R)=+1 for every symmetry matrixRetain proper rotations; model mirrored-instance semantics separately
Missing axis offsetsThe model drifts when rotated about an off-origin axisCheck S(M)=M on sampled surfaces and t=(I−R)oStore full 4×4 transforms or axis+point
Excessive canonicalizationLabels/predictions jump 90° / 180° between representatives near boundariesPerturb inputs around cell boundaries and plot output continuityMarginalize/minimize over groups during training; expose orbit rules at the interface
Averaging modesArithmetic averages of valid rotations can give a wrong pose or nonrotation matrixCheck whether the mean lies in a high-probability mode / SO(3)Output mixtures/top-K; define the decision meaning of any Fréchet mean
Incorrect symmetry groupsModels/evaluation ignore stickers, notches, or instance differencesAudit geometry, appearance, instance, and task layers separatelyVersion subgroups/evidence and manually review approximate symmetries
Substituting entropy for epistemic uncertaintySymmetric samples are labeled OOD while incorrect sharp modes appear reliableCombine symmetry, OOD, false-confidence, and weak-evidence stress setsModel multiplicity, aleatoric/epistemic uncertainty, and calibration separately
Reporting oracle top-K aloneGround truth is inside K, but actual ranking sends the robot a wrong poseReport top-1, top-K, NLL, score calibration, and downstream selection togetherTrain comparable weights and validate the verifier
One covariance spanning multiple modesEllipsoids cross low-probability regions and updates converge to nonexistent intermediate posesPlot mode separation and tangent validity radiiUse per-mode covariance with mixture weights / particles
Inconsistent calibration eventsA rotation-threshold score is interpreted as grasp success probabilityRegister target event, threshold, split, and version for each scoreRecalibrate for the task event or report only the original meaning
Coarse continuous-group discretizationMetrics/NLL change strongly with symmetry sample countsRefine sampling and check maximum surface displacement and convergenceMinimize analytically or choose justified steps from diameter/threshold
Evaluation leakageTuning temperatures, rejection thresholds, or symmetry tolerances on test dataAudit calibration / validation / test provenanceFix the protocol and fit on independent calibration splits

Release Gate · Before Outputting Pose and Confidence

  1. Are geometric, appearance, instance, and task symmetries separated and versioned?
  2. Are matrices rigid, proper, and surface-invariant, with complete axis offsets?
  3. Is q/−q equivalence handled separately from object symmetry?
  4. Are supervision, outputs, and tracking stress-tested around canonical boundaries?
  5. Are additional view-conditioned modes preserved outside global object metadata?
  6. Do continuous-group integration/discretization converge with steps tied to surface tolerance?
  7. Are top-K results accompanied by K, deduplication, ranking, coverage, NLL, and downstream selection?
  8. Does every covariance specify tangent point, left/right perturbation, frame, and units?
  9. Is confidence tied to events, metrics, thresholds, symmetry, and calibration versions?
  10. Are calibration, rejection thresholds, and task costs selected only on independent validation/calibration data?
  11. Are symmetry, occlusion, false peaks, OOD, sensor failures, and label conflicts tested separately?
  12. Does the robot check collision, contact, reachability, and fallback for all retained modes?
Primary Sources on Symmetric Pose, Probability, Uncertainty, and CalibrationExpand equivalence-class pose, EPOS, Implicit-PDF, Bingham, uncertainty, calibration, and BOP sources