01 · Symmetry
Symmetry shapes keypoints, losses, and evaluation
SD-Net changes keypoint selection and pseudo-label filtering; PS6D uses symmetry-aware rotation loss; DiffusionNOCS incorporates multiple solutions into probabilistic generation.
IROS 2024 · Paper Collection
IROS 2024 emphasizes robotic deployment: symmetry and dense stacking remain industrial challenges, category-level methods use diffusion and multiview constraints, and CAD-free onboarding, functional-end affordance pose, and controllable synthetic data develop into complete systems.
12
Official proceedings papers
4
Industry and symmetry
4
Category-level and generalization
4
Synthetic / cross-domain tags
We screened titles of all 1,581 official IROS 2024 proceedings papers, then checked outputs through abstracts and full texts. RA-L / T-RO presentations and papers using existing pose trackers only as assembly-control inputs are excluded.
View official IEEE Xplore proceedings →Collection in One Sentence
SD-Net, PS6D, and ParametricNet++ treat symmetry, stacking, reflections, and synthetic-to-real transfer as default conditions. Scalable Industrial Pose jointly considers network complexity and refinement cost.
DiffusionNOCS, MV-ROPE, and Zero123-6D pursue canonical distributions, video geometric consistency, and generative reference-view expansion. NeuSurfEmb and PEGASUS further reduce object-modeling and data-production costs.
Research Trends
Trends summarize primary contributions of the 12 included papers, rather than the distribution of all IROS papers.
01 · Symmetry
SD-Net changes keypoint selection and pseudo-label filtering; PS6D uses symmetry-aware rotation loss; DiffusionNOCS incorporates multiple solutions into probabilistic generation.
02 · Sim-to-Real
PEGASUS combines scanned objects and environments with 3DGS and physics. DiffusionNOCS and strawberry-pose work reduce real-domain gaps through multimodal generative modeling and domain randomization, respectively.
03 · Less Prior
NeuSurfEmb learns representations from a few real images, Zero123-6D expands template views through diffusion, and MV-ROPE estimates metric structure from video, reducing CAD, reference, and depth dependence, respectively.
04 · Task State
ToolEENet predicts functional-end affordance pose, while ESO-SLAM jointly estimates camera and dynamic-object states, framing pose as a state variable for tasks and temporal systems.
Data Statistics
Each paper belongs to one group by primary contribution; tags retain cross-area attributes.
Improves keypoints, point-cloud regression, domain adaptation, and refinement under weak texture, multiple symmetries, dense stacking, and size variation.
Reduces real annotations and precise-depth dependence through diffusion, NOCS, multiview constraints, and monocular novel-view synthesis.
Learns object representations from a few real images, or predicts tool-end affordance poses more directly relevant to manipulation.
Generates BOP-style data with 3D Gaussian Splatting or jointly optimizes cameras and multiple dynamic objects.
Interpreting the statistics: Industry and category-level methods each contribute 4 papers, totaling two-thirds of the collection. The other 4 cover CAD-free onboarding, functional pose, data generation, and dynamic multi-object states across the deployment lifecycle. Strictly RGB-only papers total 5 .
Recommended Reading
IROS does not use CVPR-style Highlight labels. Recommendations reflect methodological representativeness, problem completeness, and deployment value.
Jointly addresses symmetric-keypoint ambiguity and synthetic-to-real domain gaps, matching real industrial bin-picking failure modes.
Priority readingCovers algorithm and deployment validation through symmetry-aware losses, two-stage clustering, and 91.7% real bin-picking success.
Representative category-level approachModels dense canonical maps as conditional diffusion distributions to address within-category shape variation, symmetry, and multiple-solution uncertainty.
Priority readingUnifies scale-aware dense SLAM, canonical prediction, and object-level pose graphs in a multiview system.
Representative category-level approachAn early systematic test of whether diffusion-based novel-view synthesis improves pose estimation beyond generation and reconstruction.
Representative approach with fewer priorsConnects object acquisition, NeuS2 reconstruction, synthetic-image generation, and SurfEmb pose estimation into reusable CAD-free onboarding.
Priority readingHighlights tool-end affordance pose as a task state that can matter more directly than the whole-tool object pose.
Representative datasetCombines 3DGS realism and physics-engine-controlled annotations to output BOP-compatible training data.
Paper List
Each card gives task settings, input modalities, a short summary, and the official DOI. Links switch to site coarse and deep notes when details are complete.
4 papers
Improves keypoints, point-cloud regression, domain adaptation, and refinement under weak texture, multiple symmetries, dense stacking, and size variation.
Ding-Tao Huang · En-Te Lin · Lipeng Chen · Li-Fu Liu · Long Zeng
Setting: Instance-level 6D pose from synthetic training to real industrial stacked scenes
Input: point cloud / depth
Summary: Builds on pointwise keypoint regression and Hough voting, adding symmetry-class-aware keypoint selection, candidate filtering, and student–teacher geometric pseudo-labels. Reports 96% AP on Siléane and improved generalization on Parametric.
Yifan Yang · Zhihao Cui · Qianyi Zhang · Jingtai Liu
Setting: Rusty, reflective, textureless industrial parts with multiple symmetries
Input: point cloud
Summary: Uses attention-guided multiscale point-cloud features, symmetry-aware rotation loss, and center-distance-sensitive translation loss to regress instance centers and poses pointwise. Two-stage clustering separates instances and produces 6D poses, with reported F1 and Recall gains.
Yihan Xie · Wei Jie Lv · Xin-Yu Zhang · Yihong Chen · Long Zeng
Setting: 6DoF pose of industrial parts with unknown dimensional parameters in dense stacks
Input: point cloud / depth
Summary: Treats parametric shapes as a category, optimizes sparse keypoints and groups for geometric uniqueness, and predicts scene and template keypoints coarse to fine. Reports improved learning and unseen-size generalization on Siléane and Parametric.
Kun Qian · Mustafa Suphi Erden · Xianwen Kong
Setting: Detection, pose, and online refinement for industrial components spanning different sizes
Input: RGB
Summary: Uses scalable EfficientNet and enhanced feature pyramids for small-object features, combining 2D detection and geometry for adaptive refinement. Unified scaling hyperparameters control backbone and refinement complexity, evaluated on LINEMOD, a photovoltaic-component dataset, and parallel-robot experiments.
4 papers
Reduces real annotations and precise-depth dependence through diffusion, NOCS, multiview constraints, and monocular novel-view synthesis.
Takuya Ikeda · Sergey Zakharov · Tianyi Ko · Muhammad Zubair Irshad · Robert Lee · Katherine Liu · Rares Ambrus · Koichi Nishiwaki
Setting: Synthetic-only training with transfer to multiple real category-level pose datasets
Input: RGB-D / multi-modal
Summary: Predicts dense canonical maps through conditional diffusion for partial-shape recovery and correspondence, fusing multimodal input for stronger geometry. Trains only on synthetic data while demonstrating strong sim-to-real transfer across real datasets.
Jiaqi Yang · Yucong Chen · Xiangting Meng · Chenxin Yan · Min Li · Ran Cheng · Lige Liu · Tao Sun · Laurent Kneip
Setting: Category-level pose + size from moving-camera RGB video without high-quality sensor depth
Input: RGB video + optional scale cue
Summary: Estimates camera pose and metric depth through monocular dense SLAM and scale readings, predicts canonical object representations, obtains per-view object poses by registration, then jointly optimizes an object-level pose graph. Gains are stronger with poor or absent depth.
Francesco Di Felice · Alberto Remus · Stefano Gasperini · Benjamin Busam · Lionel Ott · Federico Tombari · Roland Siegwart · Carlo Alberto Avizzano
Setting: Zero-shot category-level 6D pose from a few RGB references without depth
Input: RGB
Summary: Synthesizes reference views with Zero-1-to-3, obtains coarse pose by feature matching, and refines through online optimization designed for within-category geometry differences. CO3D experiments test fewer references and depth-free estimation.
Lun Li · Hamidreza Kasaei
Setting: Strawberry detection, 6DoF pose, and dimensions under occlusion and instance-shape variation
Input: RGB
Summary: Automatically generates pose- and size-labeled strawberry data in Ignition Gazebo and trains a single-stage model with domain randomization. Reports simulated-data 3D IoU AP of 84.77%, up to 60 FPS, and transfer to real occluded scenes.
2 papers
Learns object representations from a few real images, or predicts tool-end affordance poses more directly relevant to manipulation.
Francesco Milano · Jen Jen Chung · Hermann Blum · Roland Siegwart · Lionel Ott
Setting: Few real RGB images without accurate CAD or a manual PBR pipeline
Input: reference RGB + query RGB
Summary: Semiautomatically learns NeuS2 representations through SfM and object-agnostic segmentation, generates training images through novel-view synthesis and cut-and-paste, then trains dense-correspondence SurfEmb. Compares CAD-based and CAD-free methods on LM-O and captured objects.
Yunlong Wang · Lei Zhang · Yuyang Tu · Hui Zhang · Kaixin Bai · Zhaopeng Chen · Jianwei Zhang
Setting: 6D pose of a tool's contact-performing functional end when hands occlude the tool body
Input: RGB-D
Summary: Segments tool end-effector affordances from RGB-D, predicts category-level functional-end poses through diffusion, and handles ambiguity with symmetry-aware representations. Releases TOOLEE with affordance segmentations and use-defined poses.
2 papers
Generates BOP-style data with 3D Gaussian Splatting or jointly optimizes cameras and multiple dynamic objects.
Lukas Meyer · Floris Erich · Yusuke Yoshiyasu · Marc Stamminger · Noriaki Ando · Yukiyasu Domae
Setting: Rapid physically plausible pose-training scenes assembled from real object and environment scans
Input: RGB / depth / mask / 6DoF labels
Summary: Scans environments and objects as separate 3D Gaussian representations, uses extracted meshes and physics for natural placements, then renders RGB, depth, masks, boxes, and 6DoF poses. Releases an instant-noodle-cup dataset and evaluates sim-to-real through pose networks and real grasping.
Wu Li · Yunzhou Zhang · Yuezhang Lv · Tingting Wang · Sizhan Wang · Guiyuan Wang
Setting: Joint ego and multi-object pose estimation in highly dynamic road scenes
Input: camera + LiDAR / sensor fusion
Summary: Uses a multiprobability-fusion tracker for object association, 3D Kalman velocity priors and optical-flow decoupling to remove dynamic points, then jointly refines camera and object poses through factor constraints. Listed as a dynamic-state extension rather than directly ranked with BOP rigid-instance evaluation.
Scope, Sources & Deduplication
Inclusion: official IROS 2024 proceedings papers primarily outputting instance-level / category-level object 6D pose, object tracking, functional-part pose, or data generation directly supporting 6D pose. ESO-SLAM is grouped separately as a dynamic joint camera–object extension.
Excluded: human / hand / robot pose, camera localization, grasp pose alone, 3D-box tracking, and manipulation control consuming existing poses. Insert-One primarily contributes visual–force servoing; active-vision bin picking primarily contributes sensing and motion scheduling, so neither enters the core count.
Deduplication: RA-L, T-RO, and T-ASE papers remain assigned to their journals even when presented at IROS. IEEE DOI metadata defines formal records; open PDFs, projects, and arXiv serve as reading links.
Primary sources: IEEE Xplore IROS 2024 Proceedings, paper DOIs, open author manuscripts, and project pages. Summaries, classifications, and trends are editorial work.