Back to venue collections

IROS 2024 · Paper Collection

Object Pose Estimation Papers

IROS 2024 emphasizes robotic deployment: symmetry and dense stacking remain industrial challenges, category-level methods use diffusion and multiview constraints, and CAD-free onboarding, functional-end affordance pose, and controllable synthetic data develop into complete systems.

12

Official proceedings papers

4

Industry and symmetry

4

Category-level and generalization

4

Synthetic / cross-domain tags

We screened titles of all 1,581 official IROS 2024 proceedings papers, then checked outputs through abstracts and full texts. RA-L / T-RO presentations and papers using existing pose trackers only as assembly-control inputs are excluded.

View official IEEE Xplore proceedings →

Collection in One Sentence

Toward complete deployable pose pipelines

SD-Net, PS6D, and ParametricNet++ treat symmetry, stacking, reflections, and synthetic-to-real transfer as default conditions. Scalable Industrial Pose jointly considers network complexity and refinement cost.

DiffusionNOCS, MV-ROPE, and Zero123-6D pursue canonical distributions, video geometric consistency, and generative reference-view expansion. NeuSurfEmb and PEGASUS further reduce object-modeling and data-production costs.

Research Trends

Four research themes in 2024

Trends summarize primary contributions of the 12 included papers, rather than the distribution of all IROS papers.

01 · Symmetry

Symmetry shapes keypoints, losses, and evaluation

SD-Net changes keypoint selection and pseudo-label filtering; PS6D uses symmetry-aware rotation loss; DiffusionNOCS incorporates multiple solutions into probabilistic generation.

02 · Sim-to-Real

Synthetic data becomes controllable deployment infrastructure

PEGASUS combines scanned objects and environments with 3DGS and physics. DiffusionNOCS and strawberry-pose work reduce real-domain gaps through multimodal generative modeling and domain randomization, respectively.

03 · Less Prior

CAD-free, RGB-only, and few-reference systems mature

NeuSurfEmb learns representations from a few real images, Zero123-6D expands template views through diffusion, and MV-ROPE estimates metric structure from video, reducing CAD, reference, and depth dependence, respectively.

04 · Task State

Task-relevant states extend beyond standard object frames

ToolEENet predicts functional-end affordance pose, while ESO-SLAM jointly estimates camera and dynamic-object states, framing pose as a state variable for tasks and temporal systems.

Data Statistics

Research-area distribution

Each paper belongs to one group by primary contribution; tags retain cross-area attributes.

Industrial stacking, symmetry, and efficient estimation

4

Improves keypoints, point-cloud regression, domain adaptation, and refinement under weak texture, multiple symmetries, dense stacking, and size variation.

Category-level, zero-shot, and cross-domain generalization

4

Reduces real annotations and precise-depth dependence through diffusion, NOCS, multiview constraints, and monocular novel-view synthesis.

Reduced CAD dependence and functional pose

2

Learns object representations from a few real images, or predicts tool-end affordance poses more directly relevant to manipulation.

Data generation and dynamic multi-object systems

2

Generates BOP-style data with 3D Gaussian Splatting or jointly optimizes cameras and multiple dynamic objects.

Interpreting the statistics: Industry and category-level methods each contribute 4 papers, totaling two-thirds of the collection. The other 4 cover CAD-free onboarding, functional pose, data generation, and dynamic multi-object states across the deployment lifecycle. Strictly RGB-only papers total 5 .

Recommended Reading

Recommended papers

IROS does not use CVPR-style Highlight labels. Recommendations reflect methodological representativeness, problem completeness, and deployment value.

Paper List

Paper list and summaries

Each card gives task settings, input modalities, a short summary, and the official DOI. Links switch to site coarse and deep notes when details are complete.

4 papers

Industrial stacking, symmetry, and efficient estimation

Improves keypoints, point-cloud regression, domain adaptation, and refinement under weak texture, multiple symmetries, dense stacking, and size variation.

IROS 2024 Method paper Detail page ready

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation in Bin-Picking Scenarios

Ding-Tao Huang · En-Te Lin · Lipeng Chen · Li-Fu Liu · Long Zeng

bin pickingsymmetry-aware keypointsself-trainingdomain adaptation

Setting: Instance-level 6D pose from synthetic training to real industrial stacked scenes

Input: point cloud / depth

Summary: Builds on pointwise keypoint regression and Hough voting, adding symmetry-class-aware keypoint selection, candidate filtering, and student–teacher geometric pseudo-labels. Reports 96% AP on Siléane and improved generalization on Parametric.

IROS 2024 Method paper Detail page ready

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking

Yifan Yang · Zhihao Cui · Qianyi Zhang · Jingtai Liu

point cloudmulti-symmetrytwo-stage clusteringindustrial deployment

Setting: Rusty, reflective, textureless industrial parts with multiple symmetries

Input: point cloud

Summary: Uses attention-guided multiscale point-cloud features, symmetry-aware rotation loss, and center-distance-sensitive translation loss to regress instance centers and poses pointwise. Two-stage clustering separates instances and produces 6D poses, with reported F1 and Recall gains.

IROS 2024 Method paper Detail page in progress

ParametricNet++: A 6DoF Pose Estimation Network with Sparse Keypoint Recovery for Parametric Shapes in Stacked Scenarios

Yihan Xie · Wei Jie Lv · Xin-Yu Zhang · Yihong Chen · Long Zeng

parametric partssparse keypointsstacked scenetemplate recovery

Setting: 6DoF pose of industrial parts with unknown dimensional parameters in dense stacks

Input: point cloud / depth

Summary: Treats parametric shapes as a category, optimizes sparse keypoints and groups for geometric uniqueness, and predicts scene and template keypoints coarse to fine. Reports improved learning and unseen-size generalization on Siléane and Parametric.

IROS 2024 Method paper Detail page ready

Scalable Network and Adaptive Refinement Module for 6D Pose Estimation of Diverse Industrial Components

Kun Qian · Mustafa Suphi Erden · Xianwen Kong

EfficientNetfeature pyramidadaptive refinementindustrial components

Setting: Detection, pose, and online refinement for industrial components spanning different sizes

Input: RGB

Summary: Uses scalable EfficientNet and enhanced feature pyramids for small-object features, combining 2D detection and geometry for adaptive refinement. Unified scaling hyperparameters control backbone and refinement complexity, evaluated on LINEMOD, a photovoltaic-component dataset, and parallel-robot experiments.

4 papers

Category-level, zero-shot, and cross-domain generalization

Reduces real annotations and precise-depth dependence through diffusion, NOCS, multiview constraints, and monocular novel-view synthesis.

IROS 2024 Method paper Detail page ready

DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-Level Pose Estimation

Takuya Ikeda · Sergey Zakharov · Tianyi Ko · Muhammad Zubair Irshad · Robert Lee · Katherine Liu · Rares Ambrus · Koichi Nishiwaki

category-leveldiffusionNOCSuncertaintysim-to-real

Setting: Synthetic-only training with transfer to multiple real category-level pose datasets

Input: RGB-D / multi-modal

Summary: Predicts dense canonical maps through conditional diffusion for partial-shape recovery and correspondence, fusing multimodal input for stronger geometry. Trains only on synthetic data while demonstrating strong sim-to-real transfer across real datasets.

IROS 2024 Method paper Detail page ready

MV-ROPE: Multi-View Constraints for Robust Category-Level Object Pose and Size Estimation

Jiaqi Yang · Yucong Chen · Xiangting Meng · Chenxin Yan · Min Li · Ran Cheng · Lige Liu · Tao Sun · Laurent Kneip

category-levelRGB videodense SLAMpose graphNOCS

Setting: Category-level pose + size from moving-camera RGB video without high-quality sensor depth

Input: RGB video + optional scale cue

Summary: Estimates camera pose and metric depth through monocular dense SLAM and scale readings, predicts canonical object representations, obtains per-view object poses by registration, then jointly optimizes an object-level pose graph. Gains are stronger with poor or absent depth.

IROS 2024 Method paper Detail page ready

Zero123-6D: Zero-Shot Novel View Synthesis for RGB Category-Level 6D Pose Estimation

Francesco Di Felice · Alberto Remus · Stefano Gasperini · Benjamin Busam · Lionel Ott · Federico Tombari · Roland Siegwart · Carlo Alberto Avizzano

zero-shotRGB-onlynovel-view synthesisdiffusiononline refinement

Setting: Zero-shot category-level 6D pose from a few RGB references without depth

Input: RGB

Summary: Synthesizes reference views with Zero-1-to-3, obtains coarse pose by feature matching, and refines through online optimization designed for within-category geometry differences. CO3D experiments test fewer references and depth-free estimation.

IROS 2024 Method paper Detail page ready

Single-Shot 6DoF Pose and 3D Size Estimation for Robotic Strawberry Harvesting

Lun Li · Hamidreza Kasaei

agricultural roboticssynthetic datadomain randomization3D sizereal-time

Setting: Strawberry detection, 6DoF pose, and dimensions under occlusion and instance-shape variation

Input: RGB

Summary: Automatically generates pose- and size-labeled strawberry data in Ignition Gazebo and trains a single-stage model with domain randomization. Reports simulated-data 3D IoU AP of 84.77%, up to 60 FPS, and transfer to real occluded scenes.

2 papers

Reduced CAD dependence and functional pose

Learns object representations from a few real images, or predicts tool-end affordance poses more directly relevant to manipulation.

IROS 2024 Method paper Detail page ready

NeuSurfEmb: A Complete Pipeline for Dense Correspondence-Based 6D Object Pose Estimation without CAD Models

Francesco Milano · Jen Jen Chung · Hermann Blum · Roland Siegwart · Lionel Ott

CAD-freeNeuS2SurfEmbfew real imagesdense correspondence

Setting: Few real RGB images without accurate CAD or a manual PBR pipeline

Input: reference RGB + query RGB

Summary: Semiautomatically learns NeuS2 representations through SfM and object-agnostic segmentation, generates training images through novel-view synthesis and cut-and-paste, then trains dense-correspondence SurfEmb. Compares CAD-based and CAD-free methods on LM-O and captured objects.

IROS 2024 Method paper Detail page ready

ToolEENet: Tool Affordance 6D Pose Estimation

Yunlong Wang · Lei Zhang · Yuyang Tu · Hui Zhang · Kaixin Bai · Zhaopeng Chen · Jianwei Zhang

tool affordancetool end-effectordiffusionsymmetry-awareTOOLEE

Setting: 6D pose of a tool's contact-performing functional end when hands occlude the tool body

Input: RGB-D

Summary: Segments tool end-effector affordances from RGB-D, predicts category-level functional-end poses through diffusion, and handles ambiguity with symmetry-aware representations. Releases TOOLEE with affordance segmentations and use-defined poses.

2 papers

Data generation and dynamic multi-object systems

Generates BOP-style data with 3D Gaussian Splatting or jointly optimizes cameras and multiple dynamic objects.

IROS 2024 Data and systems Detail page ready

PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generation

Lukas Meyer · Floris Erich · Yusuke Yoshiyasu · Marc Stamminger · Noriaki Ando · Yukiyasu Domae

3D Gaussian Splattingphysics simulationsynthetic dataBOP formatsim-to-real

Setting: Rapid physically plausible pose-training scenes assembled from real object and environment scans

Input: RGB / depth / mask / 6DoF labels

Summary: Scans environments and objects as separate 3D Gaussian representations, uses extracted meshes and physics for natural placements, then renders RGB, depth, masks, boxes, and 6DoF poses. Releases an instant-noodle-cup dataset and evaluates sim-to-real through pose networks and real grasping.

IROS 2024 Dynamic-scene extension Detail page in progress

ESO-SLAM: Tightly-Coupled and Simultaneous Estimation of Self and Multi-Object Pose via Sensor Fusion

Wu Li · Yunzhou Zhang · Yuezhang Lv · Tingting Wang · Sizhan Wang · Guiyuan Wang

dynamic SLAMmulti-object posesensor fusionjoint optimizationKITTI

Setting: Joint ego and multi-object pose estimation in highly dynamic road scenes

Input: camera + LiDAR / sensor fusion

Summary: Uses a multiprobability-fusion tracker for object association, 3D Kalman velocity priors and optical-flow decoupling to remove dynamic points, then jointly refines camera and object poses through factor constraints. Listed as a dynamic-state extension rather than directly ranked with BOP rigid-instance evaluation.

Scope, Sources & Deduplication

Counting rules, sources, and deduplication

Inclusion: official IROS 2024 proceedings papers primarily outputting instance-level / category-level object 6D pose, object tracking, functional-part pose, or data generation directly supporting 6D pose. ESO-SLAM is grouped separately as a dynamic joint camera–object extension.

Excluded: human / hand / robot pose, camera localization, grasp pose alone, 3D-box tracking, and manipulation control consuming existing poses. Insert-One primarily contributes visual–force servoing; active-vision bin picking primarily contributes sensing and motion scheduling, so neither enters the core count.

Deduplication: RA-L, T-RO, and T-ASE papers remain assigned to their journals even when presented at IROS. IEEE DOI metadata defines formal records; open PDFs, projects, and arXiv serve as reading links.

Primary sources: IEEE Xplore IROS 2024 Proceedings, paper DOIs, open author manuscripts, and project pages. Summaries, classifications, and trends are editorial work.