Back to the paper library

Object Pose Estimation · 2025 · WACV · CCF C

Shape-Biased Texture Agnostic Representations for Improved Textureless and Metallic Object Detection and 6D Pose Estimation

Without changing GDR-Net, Pix2Pose, or detector architectures, the paper randomly samples from 1,226 textures and UV-maps them onto objects during BlenderProc PBR rendering, reducing CNN dependence on fixed colors and materials. The full shape-biased detection–pose pipeline improves GDR-Net / Pix2Pose BOP AR from 56.29 / 46.68 to 58.32 / 50.13 on T-LESS and from 10.70 / 12.90 to 11.10 / 15.30 on ITODD. Gaussian noise, shot noise, and brightness robustness improve, while motion / Gaussian blur barely improves. Gains depend on detection and online augmentation; CAD + shape bias reaches 62.95 AR versus reconstructed meshes + shape bias at 46.57, so random textures do not replace accurate geometry.

Research area

Object Pose Estimation

Task level

Instance-level

Object setting

Seen objects

Input modalities

synthetic PBR RGB training imagesCAD or reconstructed object meshesreal RGB test images2D detections for the pose stage

Requirements

object mesh for PBR training-data generationknown object identity and one pose estimator trained per objectBlenderProc-compatible material and UV mappinga diverse opaque texture librarycamera intrinsics and BOP-format pose annotationsseparately tuned online augmentation for detector and pose estimator
Full paper metadata Authors, affiliations, research area, datasets, metrics, method tags, and reading status Expand
Authors
Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel, Matthias Hirschmanner, Markus Vincze
Affiliations
TU Wien / UAS Technikum Vienna
Conference / journal
Conference · WACV · CCF C
Research area
Object Pose Estimation
Code availability
Code available
Reading status
Overview:Available Deep Dive:Available
Task setting
Instance-level · Seen objects
Evaluation metrics
BOP AR MSPD MSSD VSD

Original paper terminology:BOP Average Recall / MSPD Average Recall / MSSD Average Recall / VSD Average Recall / COCO detection mAP / image-perturbation robustness

Requirements
object mesh for PBR training-data generationknown object identity and one pose estimator trained per objectBlenderProc-compatible material and UV mappinga diverse opaque texture librarycamera intrinsics and BOP-format pose annotationsseparately tuned online augmentation for detector and pose estimator

Reading Notes

Overview / Deep Dive

Available src/paper-notes/shape-biased-texture-agnostic-wacv2025/coarse.md

Paper overview notes

Quickly assess the paper's scope, problem setting, core method, experimental findings, and whether to read it in depth.

Overview Notes: Shape-Biased Texture Agnostic Representations for Improved Textureless and Metallic Object Detection and 6D Pose Estimation

1. Basic information

  • Short name: Randomized Texturing / Shape Bias
  • Authors: Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel, Matthias Hirschmanner, Markus Vincze
  • Affiliations: TU Wien, UAS Technikum Vienna
  • Year / venue: WACV 2025
  • Published paper: CVF Open Access
  • Code: randomized_texturing
  • Reading mode: Overview

2. Positioning in one sentence

Without changing GDR-Net, Pix2Pose, or YOLO architectures, this paper replaces random solid CAD colors during BlenderProc data generation with low-cost UV mapping of randomly selected textures from a pool of 1,226. Discouraging fixed color / surface shortcuts encourages contours, occlusion relationships, and geometric projections, improving detection and instance-level 6D pose for textureless and metallic industrial objects.

This lightweight synthetic-to-real data strategy is tested with five detectors and two pose estimators on T-LESS and ITODD. Main findings:

  • On T-LESS, fully shape-biased detection / pose pipelines raise GDR-Net BOP AR from 56.29 to 58.32, and Pix2Pose from 46.68 to 50.13;
  • On ITODD, GDR-Net rises from 10.70 to 11.10, and Pix2Pose from 12.90 to 15.30;
  • Gaussian noise, shot noise, and brightness robustness improve substantially, with little consistent benefit for motion or Gaussian blur;
  • Gains depend on the detector, online augmentation strength, and CAD / reconstructed-mesh quality; improvement is not universal.

2.1 Guide to figures and tables

Figure / tableQuestionCoarse-reading takeaway
Figure 2What changes in training data?Standard BOP PBR backgrounds, cameras, and lighting remain; random texture UV mapping replaces object solid-color sampling
Table 4Does biasing both detector and pose improve accuracy?Overall AR matches or exceeds texture baselines for two datasets / two estimators, with larger relative Pix2Pose gains
Figure 6Clean-image gains or broader robustness?Noise and brightness improve; blur barely does, bounding the appearance-reliance mechanism
Table 6Can textures compensate for poor geometry?No: accurate CAD + shape bias reaches 62.95 AR, versus reconstructed mesh + shape bias 46.57
Original Figure 2: solid-color texture bias versus randomized-texture shape bias in synthetic data generation
Original Figure 2: texture bias above samples uniform colors; shape bias below samples Creative Commons textures, applies low-cost UV mapping, then composes scenes and renders with PBR. Source: CVF Open Access. Image copyright belongs to the authors and publisher; reproduced here for paper analysis.

3. What problem does the paper address?

Many T-LESS / ITODD objects are monochrome, weakly textured, or metallic. Illumination, exposure, shadows, and highlights radically change a surface’s pixels. Models relying on fixed training colors / materials may mistake appearance changes for changes in identity or pose.

BOP synthetic data already randomizes backgrounds, cameras, poses, lighting, roughness, and specularity. Yet untextured objects commonly receive one uniformly sampled RGB color, leaving a shortcut through large, stable color regions instead of geometry.

The paper asks:

If object textures deliberately vary inconsistently across training images, will networks abandon texture shortcuts for more stable shape cues?

Shape bias describes a statistical representation preference, without explicit 3D reconstruction or complete texture disregard. More precisely, decorrelating identity from fixed surface appearance reduces reusable texture shortcuts.

4. Method: change synthetic object materials

4.1 Texture-biased baseline

The conventional configuration randomizes:

  • Specularity: uniform sampling from 0 to 1;
  • Roughness: uniform sampling from 0 to 1;
  • RGB color: each channel sampled uniformly from 0.1 to 0.9.

This creates varied colors but leaves surfaces low-frequency, continuous, and approximately uniform.

4.2 Shape-biased rendering

Keeping specularity, roughness, cameras, lighting, backgrounds, and scene composition identical, replace color sampling with:

  1. Download available textures from the CC texture database;
  2. Remove translucent textures, leaving 1,226 opaque textures;
  3. Uniformly sample a texture per object;
  4. Apply low-cost UV mapping to the CAD surface;
  5. Render complete images using BlenderProc’s BOP PBR configuration.

The training set contains 50,000 renderings. Random textures require no downstream architecture changes or substantial extra ordinary training cost.

4.3 Why not use style transfer directly?

A controlled T-LESS classification comparison reports ResNet50 top-1 / top-5 accuracy:

Representation biasTop-1Top-5
Uniform solid-color texture bias63.2286.27
AdaIN style-transfer shape bias75.8891.16
Proposed UV-mapping shape bias87.2797.37

The authors argue that mapping onto real 3D surfaces retains local geometry consistent with curvature, occlusion, and lighting. Style transfer helps classification but may suit spatially precise detection / pose less well.

5. Experimental setup

5.1 Datasets

  • T-LESS: textureless, geometrically similar, often symmetric industrial objects;
  • ITODD: metallic industrial objects with stronger reflections and low contrast.

Both train on synthetic PBR data and test on real images. Full ITODD test GT annotations are unavailable; results come from the BOP evaluation server. Metallic-object analysis is therefore less complete than T-LESS analysis, and qualitative detections cannot establish comprehensive GT statistics.

5.2 Models

Detectors include:

  • Faster R-CNN;
  • RetinaNet;
  • YOLOx;
  • YOLOv8;
  • YOLOv10.

Pose models are:

  • GDR-Net, ResNet34 backbone;
  • Pix2Pose, ResNet50 backbone.

Main pose experiments use YOLOx boxes and train a separate pose estimator per object. These do not evaluate category-level or unseen-object transfer.

5.3 Metrics

Pose evaluation follows three BOP Average Recalls:

  • AR_MSPD: symmetry-aware maximum projection distance;
  • AR_MSSD: symmetry-aware maximum surface distance;
  • AR_VSD: visible surface discrepancy;
  • Their mean gives overall BOP AR.

These surface / projection metrics evaluate full 6D pose rather than rotation accuracy alone.

6. Main 6D pose results

Original Table 4: full GDR-Net and Pix2Pose results on T-LESS and ITODD
Original Table 4: O.D. is the training bias of YOLOx object detection; P.E. is that of pose estimation. Rows three and six use shape bias at both stages. Source: CVF Open Access. Image copyright belongs to the authors and publisher; reproduced here for paper analysis.

6.1 T-LESS

ModelDetection / pose biasMSPDMSSDVSDOverall AR
GDR-Nettexture / texture72.6650.5245.7056.29
GDR-Nettexture / shape73.5452.9448.0958.19
GDR-Netshape / shape73.7353.0548.1758.32
Pix2Posetexture / texture68.3537.8533.8446.68
Pix2Posetexture / shape67.7138.2534.1046.69
Pix2Poseshape / shape71.2241.8637.3050.13

Biasing only GDR-Net pose training raises 56.29 to 58.19, so gains extend beyond boxes; biasing detection too reaches 58.32. Pix2Pose barely changes with pose bias alone, reaching 50.13 when both stages change, indicating dependence on frontend quality and distribution consistency.

Relative gains over texture baselines are 3.61% for GDR-Net and 7.39% for Pix2Pose.

6.2 ITODD

ModelDetection / pose biasMSPDMSSDVSDOverall AR
GDR-Nettexture / texture14.3010.107.8010.70
GDR-Nettexture / shape14.3010.107.8010.70
GDR-Netshape / shape15.3010.207.9011.10
Pix2Posetexture / texture22.508.008.0012.90
Pix2Posetexture / shape22.7010.1010.3014.30
Pix2Poseshape / shape23.1011.0011.7015.30

Low ITODD AR reflects difficult metallic objects. GDR-Net pose-only bias gives no gain; its improvement comes mainly from shape-biased YOLOx. Pix2Pose benefits at both stages. Full-pipeline relative gains are 3.74% for GDR-Net and 18.60% for Pix2Pose.

The 18.60% relative gain needs context: Pix2Pose improves by only 2.40 AR, ending at 15.30, far from solving metallic-object pose.

7. Robustness and ablations

7.1 Image perturbations

On T-LESS, GT detections and GDR-Net isolate five perturbations across increasing severity:

  • Gaussian noise: substantially more stable with shape bias;
  • Shot noise: substantially more stable with shape bias;
  • Brightness: clear advantage at medium / high severity;
  • Motion blur: nearly overlapping curves;
  • Gaussian blur: no consistent advantage, with both degrading rapidly at high severity.

These results bound the mechanism: random textures reduce reliance on surface appearance / local pixel statistics, but cannot recover edges and spatial detail removed by blur.

7.2 Texture count

  • All 1,226 textures give the best result;
  • Only 5 textures already reach 93.85% of that maximum;
  • 100 textures reach 99.63%.

Diversity helps, but thousands of textures are unnecessary for an initial test. Start with dozens to a hundred, then expand the library.

7.3 Online augmentation

Shape bias and ordinary online augmentation interact rather than adding independently:

  • Pix2Pose pose performs best around augmentation scales 0.2–0.4;
  • YOLOx detection peaks around 0.4;
  • Shape-biased pose generally benefits across several augmentation settings;
  • Detectors can worsen if augmentation strength is not retuned.

Fair reproduction should tune both baseline and shape-biased variants rather than mechanically copying a baseline-optimized strength.

7.4 Mesh origin

T-LESS, Pix2Pose, GT detections, augmentation scale 0.2:

MeshTraining biasAR
reconstructedtexture42.64
reconstructedshape46.57
CADcolor59.24
CADshape62.95

Random textures improve reconstructed meshes without canceling reconstruction errors; geometric accuracy and appearance randomization are complementary variables.

8. Strengths

  • Changes stay in data rendering, with little intrusion into existing detection / pose code.
  • Five detectors and two pose estimators give broader evidence than one model.
  • Separating detector and pose bias in Table 4 locates the source of gains.
  • Tests cover clean accuracy, perturbations, texture counts, augmentation, and mesh origin.
  • Negative results are explicit: some ITODD RetinaNet configurations decline, blur does not improve, and reconstructions still trail CAD substantially.
  • Public code supports direct integration into BOP / BlenderProc synthetic pipelines.

9. Limitations and risks

  • Only CNNs are studied; Vision Transformers and diffusion models remain untested.
  • Per-object pose training does not establish unseen-object or category-level gains.
  • Only T-LESS / ITODD are tested, with incomplete ITODD GT limiting metallic-object evidence.
  • Main experiments require CAD / reconstructed meshes for PBR; model-free pose is outside scope.
  • Shape bias is empirical; features are not directly shown to encode more 3D geometry.
  • Strong detector / augmentation interactions require retuning.
  • Deliberate train / test appearance mismatch may hurt tasks distinguishing near-identical shapes through stable, informative textures.
  • Absolute gains are generally moderate, and ITODD AR remains low.

10. Is a deep read worthwhile?

Yes for BOP synthetic training, T-LESS / ITODD, industrial parts, and synthetic-to-real pose.

The main strength is a clear data-strategy experiment. Reusable elements include:

  1. Randomize foreground materials alongside backgrounds and lighting;
  2. Control detector and pose training biases separately;
  3. Bound mechanisms using noise, brightness, blur, mesh origin, and augmentation grid search;
  4. Report absolute and relative gains together, especially with low baselines.

11. Coarse-reading conclusion

Randomized Texturing offers a cheap, modular intervention with explicit scope: decorrelating synthetic surface texture from identity reduces CNN dependence on fixed appearances, improving textureless / reflective-object detection and 6D pose under noise and lighting changes. Its value extends beyond the size of its BOP AR gain.

It complements geometry, detection quality, and augmentation. Accurate CAD remains more valuable than noisy reconstructions; blur still destroys important edges; detectors still need tuning. Treat it as one dimension of a synthetic-to-real toolbox, with clear applicability limits.

Related Papers

Related papers