筛选条件
未设置条件
235 篇论文
3D-Object Perception Transformer (3PT)
3PT 用两个面向 2D/3D object-centric understanding 的 Transformer 统一检测、分割和 6DoF pose,通过连续 object representation refinement 和渲染特征对齐,在 BOP-H3、BOP-Industrial 与 BOP-Classic 上实现零样本跨物体感知。
Agastya Kalra, Tim Salzmann, Guy Stoppi, Dmitrii Marin, Rishav Agarwal, Vage Taamazyan, Martin Bokeloh, Stefan Hinterstoisser, Anton Boykov, Alberto Dall’Olio, Pravin Dangol, Kartik Venkataraman, Huaijin Chen
方向:物体位姿估计
数据集:BOP-H3 / BOP-Industrial / BOP-Classic
指标:2D detection AP / segmentation AP / 6DoF pose AP-mm / BOP ranking
单位:Intrinsic
6DAttack: Backdoor Attacks in the 6DoF Pose Estimation
研究针对 PnP-based 和 end-to-end 6DoF pose pipeline 的 backdoor attack:在训练数据中注入具有 3D 结构的 trigger,并修改 pose label,使模型在干净输入上保持正常、触发时输出受控错误姿态。
Jihui Guo, Zongmin Zhang, Zhen Sun, Yuhao Yang, Jinlin Wu, Fu Zhang, Xinlei He
方向:物体位姿估计
数据集:LINEMOD / YCB-Video / CO3D
指标:ADD-C / ADD-P / PEA / 2DPE / ASR
单位:The University of Hong Kong / HKUST (Guangzhou) / Beihang University / Chinese Academy of Sciences
Active Tactile Exploration for Rigid Body Pose and Shape Estimation
方法用 violation-implicit loss 把物理约束违规纳入优化,联合估计自由运动未知凸刚体的 pose trajectory 与 cuboid / 20 顶点 polytope;再以局部 MLE 的 observed / Fisher information 计算 EIG 选择下一次触碰。仿真 cuboid 5 次动作后 EIG 稳定低于 4 mm,真实 Trifinger 第 5 步显著优于随机;边界是凸几何、局部最优、多次初始化和触觉 / 本体误差。
Ethan K. Gordon, Bruke Baraki, Hien Bui, Michael Posa
方向:物体位姿估计
数据集:Drake simulated cuboid and Platonic-solid trials / self-collected Trifinger DenseTact trials
指标:bidirectional Chamfer distance in mm / actions since first contact / 95% confidence interval / two-tailed t-test
单位:University of Pennsylvania GRASP Laboratory
Aleatoric Uncertainty from AI-based 6D Object Pose Predictors for Object-relative State Estimation
论文在 PoET 的平移与旋转分支旁增加可独立校准的异方差 MLP,用 Gaussian NLL 预测 6 个分量的对数方差,并将其作为 MaRS EKF 的动态测量协方差。单独使用动态协方差与固定噪声相近,真正稳定的收益来自按不确定性切换锚点和拒绝离群值:真实 7 次飞行的位置 RMSE 均值由 0.172 m 降至 0.146 m;但对称物体旋转 coverage 明显失配,且模型忽略平移—旋转相关与多峰分布。
Thomas Jantos, Stephan Weiss, Jan Steinbrener
方向:物体位姿估计
数据集:synthetic power-pole inspection dataset / synthetic YCB-Video subset / AIVIO real UAV inspection dataset
指标:prediction interval coverage probability at 95% / AUC of ADD-S / translation and rotation error / position and orientation RMSE / maximum position error / TensorRT inference latency
单位:University of Klagenfurt, Control of Networked Systems Group
AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment
AlignPose 把多张标定 RGB 图像中的候选姿态转换到统一 world frame,再在冻结视觉特征空间中联合优化一个 SE(3) pose,通过渲染物体与观测特征的 discrepancy 完成泛化细化。
Anna Šárová Mikeštíková, Médéric Fourmy, Martin Cifka, Josef Sivic, Vladimir Petrik
方向:物体位姿估计
数据集:YCB-V / T-LESS / HouseCat6D / ITODD-MV / IPD / XYZ-IBD
指标:BOP AR / VSD / MSSD / MSPD
单位:Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague
Learning 6D Object Pose Estimation With Event Cameras Using Synthetic Data and Domain Randomization
AEE 把 4,000 个半球视点 × 10 个面内角的 RGB 模板经边缘化和 domain randomization 映射到事件 latent codebook,用真实 event crop 检索旋转并由框中心 / 物体尺度近似平移。检索约 5 ms,但 10% ADD-S full-pose 对检测框极敏感;wood block 仅 2.5%,cracker box 达 86.0%。
Oussama Abdul Hay, Xiaoqian Huang, Muhammad Ahmed Humais, Abdulla Ayyad, Randa Almadhoun, Yahya Zweiri
方向:物体位姿估计
数据集:E-POSE
指标:ADD-S at 10% diameter for rotation / ADD-S at 10% diameter for full pose / inference latency
单位:Advanced Research and Innovation Center / University of Sunderland / Khalifa University
Breaking the 3D Dataset Bottleneck: Fast Scalable Generation of Aligned 3D Assets from Scratch for Category 6D Pose Estimation and Robotic Grasping
该工作以 text-to-image-to-3D 流程批量生成带 canonical 对齐关系的物体资产和完整标注,用于类别级 6D pose、形状补全和机器人抓取,目标是降低高质量 3D 数据生产的时间与人工成本。
Duret Guillaume, Danylo Mazurak, Florence Zara, Jan Peters, Liming Chen
方向:物体位姿估计
数据集:GenOmni3D / category-level pose data / robot grasping data
指标:pose consistency / shape completion IoU / grasp success / generation time
单位:Inria / TU Darmstadt
C3PO: Canonicalization of 3D Pose from Partial Views with Generalizable Correspondence Features
C3PO 将 partial-view category canonicalization 表述为跨视频的对应与 registration:先学习能跨未见类别泛化的 correspondence feature,再以 pairwise registration 和 global optimization 对齐多段局部形状。
Yu Chi, Leonhard Sommer, Olaf Dünkel, Dominik Muhle, Daniel Cremers, Christian Theobalt, Adam Kortylewski
方向:物体位姿估计
数据集:ShapeNet / CO3Dv2
指标:30° canonicalization accuracy
单位:Technical University of Munich / University of Freiburg / Max Planck Institute for Informatics / CISPA Helmholtz Center for Information Security
CanoVerse: 3D Object Scalable Canonicalization and Dataset for Generation and Pose
CanoVerse 将 3D 物体规范化从连续 SO(3) 手工旋转改写为“类别模板与几何/语义准则生成 5 个候选 + 人工一键选择”,从 75 万个 Objaverse / Objaverse-XL 资产中保留 32 万个、覆盖 1,156 类的规范化数据。其 VI-Net 在 OmniObject3D 跨域朝向恢复上达到 Acc@10° 20.18、Acc@30° 24.83,显著高于 Objaverse-OA 训练版本的 6.56 / 9.60;但它估计的是中心化完整点云相对规范坐标系的旋转,不直接恢复相机坐标系中的平移,也不等同于从场景 RGB/RGB-D 完成检测、分割与 6D pose。
Li Jin, Yuchen Yang, Weikai Chen, Yujie Wang, Dehao Hao, Tanghui Jia, Yingda Yin, Zeyu Hu, Runze Zhang, Keyang Luo, Li Yuan, Long Quan, Xin Wang, Xueying Qin
方向:物体位姿估计
数据集:CanoVerse / Objaverse / Objaverse-XL / OmniObject3D / Toys4K / Google Scanned Objects / DREDS
指标:Acc@10 degrees / Acc@30 degrees / absolute angular error / Chamfer Distance / LPIPS / CLIP score / orientation IQR / Recall@10 / Recall@30 / IC / GEC / annotation seconds per object
单位:Shandong University / LIGHTSPEED STUDIOS / University of North Carolina at Chapel Hill / Hong Kong University of Science and Technology / Peking University
CAOA: Completion-Assisted Object-CAD Alignment
CAOA 先用 context-aware point completion 修复 scan 中缺失的对象几何,再把 symmetry encoding 与 Siamese object–CAD alignment 网络结合,预测 translation、rotation 与 per-axis scale 的 9DoF 对齐。
Hiranya Garbha Kumar, Minhas Kamal, Balakrishnan Prabhakaran
方向:物体位姿估计
数据集:Scan2CAD / ScanNetv2 / S2C-Completion / SN-Indoor
指标:9DoF alignment accuracy / Chamfer Distance
单位:University at Albany, State University of New York
COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation
COG 将单参考未知物体 pose 估计转化为带点级置信度的 optimal transport correspondence,通过几何、语义和 cycle consistency 抑制非重叠区域与离群点,再用加权 SVD 恢复相对 6DoF pose。
Yuchen Che, Jingtu Wu, Hao Zheng, Asako Kanezaki
方向:物体位姿估计
数据集:TUD-L / LM-O / YCB-V / BOP
指标:BOP AR / VSD / MSSD / MSPD / overlap IoU / inference time
单位:Institute of Science Tokyo / RIKEN / Tohoku University
Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices
方法用光照变化下相对稳定的 edge color-pair 同时支撑初始 RGB-D–mesh 注册与光流对应筛选:YCB-V 15 个纹理对象平均 ADD / ADD-S 为 60.9 / 78.6,Fast-YCB tracking ADD 为 93.13;Jetson Orin 五对象初始估计约 7 FPS、Xavier tracking 超 20 FPS,但依赖纹理、CAD、检测与深度。
Xingjian Yang, Ashis G. Banerjee
方向:物体位姿估计
数据集:YCB-Video / Fast-YCB / LoCoBot real-world sequence
指标:ADD / ADD-S / tracking ADD / relative rotation error / relative translation error / optical-flow EPE / FPS
单位:University of Washington Department of Mechanical Engineering / University of Washington Department of Industrial & Systems Engineering
ComPose: A Unified Completion-Pose Framework for Robust Category-Level Object Pose Estimation
ComPose 把类别级部分点云的形状补全与姿态估计统一起来,先预测稀疏关键点及其局部 dense neighborhoods,再用几何关系编码和 consistency loss 完成 NOCS 对齐,减少对类别形状先验的依赖。
Huan Ren, Yihan Chen, Chuxin Wang, Nailong Liu, Wenfei Yang, Tianzhu Zhang
方向:物体位姿估计
数据集:REAL275 / CAMERA25
指标:10 degree 2 cm accuracy / 3D IoU / inference FPS
单位:University of Science and Technology of China / Beijing Institute of Control Engineering
ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors
ConceptPose 用 LLM 生成开放词汇概念,再让 VLM 产生密集 saliency 与 3D concept map,通过 concept vector 相似度建立跨视角 3D-3D 对应并用 Umeyama 求解零样本相对 pose。
Liming Kuang, Yordanka Velikova, Mahdi Saleh, Jan-Nico Zaech, Danda Pani Paudel, Benjamin Busam
方向:物体位姿估计
数据集:REAL275 / Toyota-Light / YCB-Video / LINEMOD
指标:ADD(-S) recall / ADD-AUC / ADD-S-AUC / BOP AR / 3D IoU
单位:University of Bonn / Toyota Research Institute
CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation
面向没有 CAD 的未知物体单参考 6D pose,先把 reference/query 的 3D-3D 对应表示为 ROC map,再用离散 token 的自回归生成替代连续坐标回归,最后通过 Umeyama 算法恢复相对姿态。
Dexin Zuo, Ang Li, Wei Wang, Wenxian Yu, Danping Zou
方向:物体位姿估计
数据集:Real275 / Toyota-Light / YCB-Video / LINEMOD / FoundationPose / OO3D-9D
指标:ADD(-S) Recall / AUC ADD / AUC ADD-S / AR (MSSD/MSPD/VSD) / Inference time
单位:Shanghai Jiao Tong University / Midea Group
Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation
Cov2Pose 用空间协方差池化将图像特征压缩为 SPD 矩阵,并在流形感知的 pose head 中编码旋转与平移,避开欧氏空间直接回归在遮挡和旋转表示上的不一致。
Nassim Ali Ousalah, Peyman Rostami, Vincent Gaudillière, Emmanuel Koumandakis, Anis Kacem, Enjie Ghorbel, Djamila Aouada
方向:物体位姿估计
数据集:LINEMOD / Occluded LINEMOD / YCB-Video
指标:ADD(-S) / AUC ADD-S / AUC ADD(-S) / inference time
单位:University of Luxembourg
DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces
DICArt 将类别级可动物体 pose 放入离散状态空间,用 Flexible Flow Decider 改善离散扩散去噪,并以 hierarchical kinematic coupling 在遮挡下联合恢复刚性部件、关节轴和 articulation state。
Li Zhang, Mingyu Mei, Ailing Wang, Xianhui Meng, Yan Zhong, Xinyuan Song, Liu Liu, Rujing Wang, Zaixing He, Cewu Lu
方向:物体位姿估计
数据集:ReArtMix / RobotArm / synthetic articulated objects
指标:rotation error / translation error / joint angle error / axis distance error
单位:University of Science and Technology of China / Shanghai Jiao Tong University / Zhejiang University / East China Normal University / Peking University / Emory University / Hefei University of Technology
DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects
DKPMV 在 CAD 上以 FPS 采样 512 个关键点,用对称性感知训练和局部注意力提升各视角的关键点预测,再以稠密多视图对应依次重建关键点云、Umeyama 对齐和重投影优化。ROBI 上 8 视角 RealSense 的整体 ADD AR / 5 mm 10° recall 达 95.5 / 93.6,但仍依赖 CAD、标定外参和目标检测。
Jiahong Chen, Jinghao Wang, Zi Wang, Ziwen Wang, Banglei Guan, Qifeng Yu
方向:物体位姿估计
数据集:ROBI
指标:ADD average recall / 5 mm 10° recall / 2 mm 3° recall
单位:National University of Defense Technology / Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation
DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios
DynOPETs 提供 175 条动态物体 / 移动相机 RGB-D 序列、约 21 万帧和 53 万余标注,并统一覆盖 category-level、unseen-object pose 与 tracking。其标注融合 FoundationPose 绝对位姿、TAP 相对运动和 SE(3) pose graph;10 条额外 mocap 序列中 PGO 位姿平均 ATE 为 4.94 mm。数据价值很高,但“真值”主体仍是经人工剔边的伪标注流水线,独立 mocap 验证只覆盖 10 条序列。
Xiangting Meng, Jiaqi Yang, Mingshu Chen, Chenxin Yan, Yujiao Shi, Wenchao Ding, Laurent Kneip
方向:物体位姿估计
数据集:DynOPETs COPE-119 / DynOPETs UOPE-56 / ten-object marker-based mocap validation set
指标:3D IoU / 5°2 cm and 10°5 cm accuracy / BOP average recall / ATE / rotation and translation RPE / AUC of ADD and ADD-S
单位:ShanghaiTech University / Fudan University
EgoXtreme: A Dataset for Robust Object Pose Estimation in Egocentric Views under Extreme Conditions
EgoXtreme 将低光、运动模糊、烟雾、严重遮挡、近距离截断等条件带入 egocentric 物体位姿评测,覆盖工业维护、运动和应急救援场景,用于检验实验室方法的真实泛化能力。
Taegyoon Yoon, Yegyu Han, Seojin Ji, Jaewoo Park, Sojeong Kim, Taein Kwon, Hyung-Sin Kim
方向:物体位姿估计
数据集:EgoXtreme / YCB-V / HOT3D
指标:ADD(-S) / ADD-S AUC / pose tracking accuracy / condition-wise recall
单位:Seoul National University / VGG, University of Oxford
Keypoint-Based Dynamic Object 6-DoF Pose Tracking via Event Camera
网络从 event time surface 检测语义关键点,经预建 hash 建 2D–3D 对应并用 EPnP 自动初始化;后续以极性、空间距离和局部 event density 传播关键点,EKF 抑制抖动。自建仿真 / EVK4 数据上多数旋转误差显著低于 EDOPT,但数据规模小、模型和关键点均预先已知。
Zhe Wang, Qijin Song, Zihao Li, Jingyu Xiao, Weibang Bai
方向:物体位姿估计
数据集:self-collected simulated mechanical-parts event set / self-collected Prophesee EVK4 real event set
指标:relative rotation error in deg/s / relative translation error in cm/s
单位:ShanghaiTech Automation and Robotics Center / ShanghaiTech University / WLSA Shanghai Academy
Event-based Motion & Appearance Fusion for 6D Object Pose Tracking
该学习免事件跟踪器并行解码 event optical flow 与速度无关 EROS:前者经 KF 推断 6D velocity 做传播,后者与 13 个局部渲染模板匹配做校正,最后 UKF 平滑。8 条合成序列平均消融为 2.18 cm / 14.57°,快运动部分接近 FoundationPose;但真实集无真值,完整在线系统尚未实现,约 110 Hz 只是组件耗时推算。
Zhichao Li, Chiara Bartolozzi, Lorenzo Natale, Arren Glover
方向:物体位姿估计
数据集:synthetic 500 Hz YCB motion sequences / self-collected real YCB event sequences
指标:translation RMSE and standard deviation in cm / rotation RMSE and standard deviation in degrees / component latency
单位:Istituto Italiano di Tecnologia / University of Genoa
Event6D: Event-based Novel Object 6D Pose Tracking
Event6D 面向未知物体的高速跟踪,利用事件流和最新深度帧在任意时间戳重建 intensity/depth,再做 render-and-compare pose tracking,系统速度超过 120 FPS 并在真实事件数据上验证泛化。
Jae-Young Kang, Hoonhee Cho, Taeyeop Lee, Minjun Kang, Bowen Wen, Youngho Kim, Kuk-Jin Yoon
方向:物体位姿估计
数据集:EventBlender6D / EventHO3D / Event6D
指标:pose tracking accuracy / ADD(-S) / tracking FPS / rotation / translation error
单位:KAIST / NVIDIA
Fast-WAM: Do World Action Models Need Test-time Future Imagination?
Fast-WAM 保留训练时的未来视频预测,通过注意力掩码让动作只读取当前观测;部署时将 Wan2.2 视频骨干作为单次编码器,再以动作专家进行 10 步去噪,无需生成未来视频。论文在 RoboTwin 2.0 / LIBERO 上取得 91.8% / 97.6% 平均成功率;RTX 5090D V2 上延迟 190 ms,相比 IDM 的 810 ms 加速约 4.26 倍。它是需要机器人示教的世界动作模型,不输出物体 6D pose;真实任务仍有速度与成功率的取舍。
Tianyuan Yuan, Zibin Dong, Yicheng Liu, Hang Zhao
方向:世界模型
数据集:LIBERO / RoboTwin 2.0 / Galaxea R1 Lite towel folding
指标:task success rate / average completion time / inference latency
单位:IIIS, Tsinghua University / Galaxea AI
Finding NeMO: A Geometry-Aware Representation of Template Views for Few-Shot Perception
NeMO 将少量 RGB template 编码成带几何与语义的 object-centric point memory,单一 decoder 复用该 memory 完成训练未见对象的 detection、segmentation、surface prediction 与 6DoF pose。
Sebastian Jung, Leonard Klüpfel, Rudolph Triebel, Maximilian Durner
方向:物体位姿估计
数据集:BOP HOPEv2 / HANDAL / T-LESS / TUD-L / YCB-Video
指标:AP / AR / MSPD / MSSD
单位:German Aerospace Center (DLR)
Follow My Hold: Hand-Object Interaction Reconstruction through Geometric Guidance
FollowMyHold 在 pretrained rectified-flow 3D generator 的采样中加入多阶段 geometric guidance,同时优化 hand / object transforms,并以 depth、normal、silhouette、keypoint 和 SDF contact 约束得到物理一致的 HOI reconstruction。
Ayce Idil Aytekin, Helge Rhodin, Rishabh Dabral, Christian Theobalt
方向:物体位姿估计
数据集:OakInk / ARCTIC / DexYCB
指标:F-score@5mm / F-score@10mm / Chamfer Distance / intersection volume / reconstruction rate
单位:Max Planck Institute for Informatics / Saarland University / Bielefeld University
GaussianArt: Unified Modeling of Geometry and Motion for Articulated Objects
GaussianArt 用 articulated 3D Gaussians 将 part geometry 与 motion decomposition 统一学习,并借助 part segmentation、L0 与 trajectory regularization 处理最多 20 个部件的可动物体数字孪生。
Licheng Shen, Saining Zhang, Honghan Li, Peilin Yang, Zihao Huang, Zongzheng Zhang, Hao Zhao
方向:物体位姿估计
数据集:MPArt-90 / PartNet-Mobility / MultiScan
指标:axis angle error / axis position error / part motion error / Chamfer Distance
单位:Beijing Academy of Artificial Intelligence / Tsinghua University / Nanyang Technological University / Beijing Institute of Technology / Huazhong University of Science and Technology
GenHOI: Generalized Hand-Object Pose Estimation with Occlusion Awareness
GenHOI 从对象中心单目 RGB 联合恢复 MANO 手部与对象旋转、平移:InstructBLIP 生成对象—手—交互三层描述,图像 / 文本 / 训练真值网格点云通过多模态掩码重建学习遮挡表征,预测手旋转与 3D 关节再分别约束对象 rotation / translation head。DexYCB S3 三个未见对象的平均 ADD-0.5D 报告值为 89.34、ADD-S 为 21.76 mm,显著优于表中对照;但四项手部指标均略逊于 UniHOPE,HO3Dv2 PA-MJE 也非最佳。推理不需 CAD 或深度传感器,但依赖对象 crop、图像引导 voxel sampling,且 18 FPS 不包含离线 InstructBLIP 文本生成。
Hui Yang, Wei Sun, Jian Liu, Jian Xiao, Tao Xie, Hossein Rahmani, Ajmal Mian, Nicu Sebe, Gim Hee Lee
方向:物体位姿估计
数据集:DexYCB S0 / DexYCB S3 / HO3Dv2
指标:ADD-0.5D / ADD-S / MJE / PA-MJE / ST-MJE / V-PE / OCE / MCE / OME / F@5 / F@15
单位:NERC-RVC, Hunan University / National University of Singapore / Lancaster University / The University of Western Australia / University of Trento
GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
GeniWorld 以 URDF 渲染将数值动作变成与相机对齐的视觉运动条件,驱动 Wan2.2 因果视频模型预测环境响应,支持闭环策略评测与数据合成。论文在 RoboTwin Clean-to-Random 上报告 FVD 20.15、EWMScore 63.54;合成数据使四个真实任务、五种设置的策略总体成功率从 40.8% 提升至 69.0%。它生成未来观测而非动作或物体 pose,依赖机器人模型与相机标定;官方代码尚标注 Coming soon。
Chenghao Gu, Hanyang Yu, Jingbo Zhang, Haitao Lin, Wenyao Zhang, Jinghe Wang, Hanglei Jin, Shuzhao Xie, Jingyan Jiang, Zhi Wang
方向:世界模型
数据集:RoboTwin 2.0 / WorldArena evaluation protocol / Xtrainer real-world manipulation
指标:LPIPS / PSNR / SSIM / FID / FVD / EWMScore / task success rate
单位:Shenzhen International Graduate School, Tsinghua University / Tencent Robotics X / The Hong Kong University of Science and Technology / Shenzhen Technology University
GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes
GraspClutter6D 汇集 1000 个真实密集场景、200 个对象、5.2 万 RGB-D 图像、735,545 个位姿实例与 93 亿个解析抓取候选。它用四相机 UR5 刚性平台、13 视角融合和双专家复核建立 pose,再把物体级 force-closure grasp 投影到场景并做碰撞过滤。其训练数据让真实 15 物体 pile 抓取从 GraspNet-1B 的 54.9% 提至 67.9%,但“93 亿抓取”并非真实执行次数,深度残差也混合了位姿、mesh 与传感器误差。
Seunghyeok Back, Joosoon Lee, Kangmin Kim, Heeseon Rho, Geonhyup Lee, Raeyoung Kang, Sangbeom Lee, Sangjun Noh, Youngjin Lee, Taeyeop Lee, Kyoobin Lee
方向:物体位姿估计
数据集:GraspClutter6D / YCB-Video transfer benchmark / real UR5 cluttered-grasp benchmark
指标:mean absolute depth discrepancy / viewpoint coverage / real grasp success rate / ADD(-S) and ADD-S AUC / instance segmentation AP / 6-DoF grasp AP
单位:Korea Institute of Machinery and Materials / Gwangju Institute of Science and Technology / Korea Advanced Institute of Science and Technology
Reconstructing Hand-Held Objects in 3D from Images and Videos
MCC-HO 从单图和推断的 3D hand 联合恢复手物几何,RAR 用 VLM 检索匹配的 3D object model 并与多帧观测刚体对齐;手部作为尺度和位置的强几何锚点。
Jane Wu, Georgios Pavlakos, Georgia Gkioxari, Jitendra Malik
方向:物体位姿估计
数据集:DexYCB / MOW / HOI4D / 100 Days of Hands
指标:F-score@5mm / F-score@10mm / Chamfer Distance / intersection volume
单位:University of California, Berkeley / The University of Texas at Austin / California Institute of Technology
HIPPo: Harnessing Image-to-3D Priors for Model-Free Zero-Shot 6D Pose Estimation
HIPPo 从第一帧 RGB-D 以 Wonder3D + MASt3R 在约 8 秒生成带尺度完整 mesh,随后用 FoundationPose 约 15 FPS 估计 / 跟踪,并由 viewpoint sphere 触发真实观测替换 diffusion prior。单参考下 YCB-V / LM-O ADD AUC 达 89.07 / 88.49;优势是即时接入,代价是 mesh update 约 9.87 秒且重遮挡仍会污染初始生成。
Yibo Liu, Zhaodong Jiang, Binbin Xu, Guile Wu, Yuan Ren, Tongtong Cao, Bingbing Liu, Rui Heng Yang, Amir Rasouli, Jinjun Shan
方向:物体位姿估计
数据集:YCB-Video / LM-O / HIPPo custom reconstruction set
指标:ADD AUC / ADD-S AUC / Chamfer distance / initialization and update latency
单位:Huawei Noah’s Ark Lab / York University / University of Toronto
Towards in-the-wild Egocentric 3D Hand-Object Pose Estimation
EPIC-Contact 用手部接触绘制、区域级双射接触转移与 EC-fit,把 2,272 个第一人称稳定抓握 clips 扩成 62.3K 帧 posed hand-object meshes;HOPformer 则让 DINOv2 对象 token 在 12 层 decoder 中读取 WiLoR 手 pose token,一次前向联合预测双手 MANO、对象类别、旋转 / 平移与可选关节角。相对最强 JointTransformer,EPIC 的 CDev 由 30.1 降至 20.7 mm、SR@0.05 由 17.6% 升至 29.8%;但主 pose 表使用 oracle mesh,自动分类准确率仅 52.9%,且官方仓库披露 EPIC checkpoint 约 1.28× 投影尺度与 0.78×绝对深度偏差,因此结果主要证明相对 / root-aligned hand-object pose 改进,而非开放世界或已校准的绝对 6D pose。
Siddhant Bansal, Zhifan Zhu, Shashank Tripathi, Jiahe Zhao, Michael J. Black, Dima Damen
方向:物体位姿估计
数据集:EPIC-Contact / ARCTIC / EPIC-Grasps / EPIC-KITCHENS VISOR
指标:CDev / MRRPE / MDev / hand / object ACC / MPJPE / AAE / SR@0.05 / SR@0.1 / object classification accuracy
单位:University of Bristol / Max Planck Institute for Intelligent Systems, Tübingen
HRDexDB: A Paired Human-Robot Dataset for Cross-Embodiment Dexterous Grasping
HRDexDB 以 21 个外部相机和 2 个第一视角相机记录 100 个物体、2.1K 条人类与四种灵巧手配对抓取序列,提供约 24M 帧、3D 手部、物体 6D 位姿、机器人状态与触觉标注,并用接触迁移、跨本体抓取检索、手部重建和抓取遮挡下物体位姿基准验证其用途。
Jongbin Lim, Taeyun Ha, Mingi Choi, Jisoo Kim, Byungjun Kim, Subin Jeon, Hanbyul Joo
方向:机器人感知与操作
数据集:HRDexDB / FreiHAND / OmniRobotHome / Google Scanned Objects
指标:grasp success rate / R@1 / R@3 / R@5 / PA-MPJPE / PA-MPVPE / ADD / ADD-S / AR_MSSD
单位:Seoul National University / RLWRLD
IndustryShapes: An RGB-D Benchmark Dataset for 6D Object Pose Estimation of Industrial Assembly Components and Tools
IndustryShapes 用 5 个无纹理、反光、薄结构或对称工业件构造 Classic 与 Extended 两套 BOP 数据:共 34 场景、约 2.24 万位姿标注,并加入 10 条静态 RGB-D onboarding 序列。FoundationPose model-based 在 Classic / Extended 的 BOP AR 为 0.67 / 0.69,明显高于 model-free 的 0.25 / 0.33;但数据仅 5 个对象,训练 / 测试场景复杂度不均,且正文对 Extended 深度误差的文字与 Table IV 存在口径不一致。
Panagiotis Sapoutzoglou, Orestis Vaggelis, Athina Zacharia, Evangelos Sartinas, Maria Pateraki
方向:物体位姿估计
数据集:IndustryShapes Classic / IndustryShapes Extended
指标:ADD recall / BOP average recall / VSD / MSSD / MSPD / detection and segmentation mAP / depth discrepancy
单位:National Technical University of Athens
InstantPose: Zero-Shot Instance-Level 6D Pose Estimation From a Single View
InstantPose 先由一张无位姿 RGB reference 生成粗糙 mesh 和 400 个模板,再以 DINOv2 匹配 query、双侧深度提升 3D 对应,并用 RANSAC + Umeyama 联合求旋转、平移与尺度。YCB-V 的 BOP AR 为 36.83、A4500 上约 3.9 s;单视图 onboarding 方便,但受重建质量、遮挡和弱纹理对应限制。
Francesco Di Felice, Alberto Remus, Stefano Gasperini, Benjamin Busam, Lionel Ott, Stefan Thalhammer, Federico Tombari, Carlo Alberto Avizzano
方向:物体位姿估计
数据集:YCB-Video
指标:BOP average recall / VSD / MSSD / MSPD / inference time / robot grasp success
单位:Scuola Superiore Sant’Anna / Leonardo S.p.A. / Technical University of Munich / MCML / ETH Zürich Autonomous Systems Lab / UAS Technikum Wien / Google Zürich
InvariantCloud: A Globally Invariant, Uniquely Indexed Point Cloud Framework for Robust 6-DoF Tactile Pose Tracking
InvariantCloud 预建带唯一 ID 的 475 点触觉全局网格,逐帧无需 LK / 最近邻搜索即可一一匹配:Kabsch 解 roll / pitch,接触轮廓 PCA 解 yaw,质心与高度解平移。一分钟静止测试的平移 MAE 为 0.22 / 0.14 / 0.11 mm,yaw 0.84°;对蛋等弱轮廓也明显优于 NormalFlow,但完全球形接触的 yaw 不可观。
Pengfei Ye, Yuxiang Ma, Yi Zhou, Wei Chen, Wenzhen Dong, Molong Duan
方向:物体位姿估计
数据集:self-collected GelSight Mini household-object sequences / self-collected multi-contact tactile SLAM sequence
指标:one-minute static cumulative MAE / return-pose repeatability error / Z-axis tracking error / surface reconstruction consistency
单位:Hong Kong University of Science and Technology / Massachusetts Institute of Technology / Chinese University of Hong Kong
iTACO: Interactable Digital Twins of Articulated Objects from Casually Captured RGBD Videos
iTACO 从同时存在手持相机运动、对象运动与遮挡的 RGB-D video 中,先以静态 / 动态对应得到 joint 的 coarse state,再以可微 refinement 与 part segmentation 优化关节参数和可动部件。
Weikun Peng, Jun Lv, Cewu Lu, Manolis Savva
方向:物体位姿估计
数据集:iTACO S-Dataset / iTACO L-Dataset / PartNet-Mobility
指标:joint axis error / joint position error / joint type error / joint state error / Chamfer Distance
单位:Simon Fraser University / Shanghai Jiao Tong University
KV-Tracker: Real-Time Pose Tracking with Transformers
KV-Tracker 将多视角视觉几何 Transformer 的全局信息缓存为 key-value 场景表示,使模型可以在单目视频中在线更新物体 pose 与几何,减少反复全局计算和长期漂移。
Marwan Taher, Ignacio Alzugaray, Kirill Mazur, Xin Kong, Andrew Davison
方向:物体位姿估计
数据集:TUM RGB-D / object pose tracking benchmarks
指标:tracking accuracy / ATE / rotation / translation error / FPS
单位:Imperial College London
M-VTOP: Modular Visuo-Tactile Object Pose Estimation for High-Precision Robotic Manipulation
M‑VTOP 把视觉与 GelSight 观测统一成 mask,对每个 SE(3) 粒子渲染 CAD mask 并按 IoU 更新 belief,再以物体—环境 signed distance 注入软接触似然。真实五类插入中,视觉触觉融合的 SAM2 / Mask R-CNN 平均成功率为 93% / 100%,高于单模态;代价是整系统仅 0.4 Hz,且依赖 CAD、标定、刚体与稳定抓持假设。
Miquel Oller, Qiyang Qian, Radu Corcodel, Siddarth Jain
方向:物体位姿估计
数据集:five-object simulated pose benchmark / five-object real insertion benchmark
指标:mean bounding-box pose error / translation error in mm / rotation error in degrees / insertion success rate
单位:Mitsubishi Electric Research Laboratories / University of Michigan / University of California, Berkeley
MemPose: Category-level Object Pose Estimation with Memory
MemPose 在 AG-Pose 风格的 RGB-D 类别级 9DoF pipeline 中加入按类别维护、长度 96 的外部 feature memory:历史实例的 pooled local keypoint features 通过带 Gumbel 扰动的 similarity merge 更新,当前关键点用 attention 读取并经 gate 融合。冻结 memory 的主结果在 REAL275 达到 IoU75 81.0 / 5°2 cm 59.9,在 HouseCat6D 达到 IoU50 81.5 / IoU75 56.4,在 Wild6D 达到 IoU75 46.2;模型为 225M、33 FPS,而 AG-Pose 为 223M、35 FPS。测试时更新可进一步把 REAL275 的 5°2 cm 提高到 63.6,但仅属附加实验,尚未建立完整 stream-order 与防污染协议。
Xiao Lin, Minghao Zhu, Yun Peng, Liuyi Wang, Qiyi Wang, Chengju Liu, Qijun Chen
方向:物体位姿估计
数据集:REAL275 / CAMERA25 / HouseCat6D / Wild6D
指标:3D IoU mAP / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:Tongji University / State Key Laboratory of Autonomous Intelligent Unmanned Systems
Monocular Vehicle Pose and Shape Reconstruction via Dynamic Context Adaptation and Progressive Geometry Refinement
面向自动驾驶远距离车辆,MonoVPR 用 HDCA 融合 object-centric geometry 与 scene-centric semantics,再用 BIMR 的 tanh-bounded iterative mesh refinement 同时改善 3D pose 和形状恢复。
Wei Li, Long Ji, Ying Wang, Xiao Wu, Zhaoquan Yuan, Penglin Dai
方向:物体位姿估计
数据集:ApolloCar3D
指标:A3DP-Abs / A3DP-Rel / Rotation Error / Translation Error / mIoU
单位:Southwest Jiaotong University / Engineering Research Center of Sustainable Urban Intelligent Transportation
Deep Learning-Based Object Pose Estimation: A Comprehensive Survey
系统梳理实例级、类别级与未知物体位姿估计,并在评测部分按 3DoF、6DoF、9DoF 与形状重建拆解 Geodesic、BOP、ADD(-S)、2D Projection、3D IoU 与 Chamfer Distance 等指标。
Jian Liu, Wei Sun, Hui Yang, Zhiweng Zeng, Chongpei Liu, Jin Zheng, Xingyu Liu, Hossein Rahmani, Nicu Sebe, Ajmal Mian
方向:物体位姿估计
数据集:BOP / LINEMOD / YCB-Video / NOCS / HouseCat6D
指标:Geodesic rotation error / ADD / ADD-S / ADD(S) / ADD AUC / n° mcm / 2D Projection / VSD / MSSD / MSPD / BOP AR / 3D IoU / Chamfer Distance
单位:National Engineering Research Center for Robot Visual Perception / Lancaster University / University of Western Australia
OrienPose: Orientation-Guided Novel View Synthesis for Single-Image Unseen Object Pose Estimation
OrienPose 针对单图未知物体的 novel-view synthesis 引入 Orientation-Aware Guidance,并用 Orientation Consistency Loss 约束视角变换下的几何一致性,再通过新视图模板匹配估计 pose。
Yating Liu, Zhaoshuai Qi, Yang Zou, Yongnan Yang, Shizhou Zhang, Yanning Zhang
方向:物体位姿估计
数据集:ShapeNet / NAVI
指标:pose accuracy / ADD(-S) / AUC / ACC@30
单位:Northwestern Polytechnical University
Pose Anything Anywhere: Model-free Object Poses from Arbitrary References
PANY 面向无 CAD 的未见物体 6D pose:以一个具有规范位姿的 anchor 和可选无位姿 assist views 为参考,LoRA 适配 VGGT 预测多视图几何,再用几何—视觉融合描述子、跨视图对比学习和 pose graph 注册恢复 query pose;RGB 走 PnP,RGB-D 走 Umeyama。单参考下 YCB-V ADD AUC 为 92.5,加入 8 个 assist views 后为 94.6,LINEMOD ADD-0.1d 从 55.3 提至 87.4;但“arbitrary / pose-free references”仍隐含一个已定义 canonical pose 的 anchor、对象 mask 和足够视图连通性。
Hongli Xu, Jiaqi Hu, Junwen Huang, Boyang Zhong, Peter KT Yu, Nassir Navab, Benjamin Busam, Slobodan Ilic
方向:物体位姿估计
数据集:Omni6DPose / REAL275 / Toyota-Light / YCB-Video / LINEMOD / LINEMOD-Occlusion
指标:BOP Average Recall / ADD-0.1d / ADD AUC / inference time
单位:Technical University of Munich / Munich Center for Machine Learning / Siemens AG / XYZ Robotics / ROBOX
Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers
Point2Pose 从每个未知刚体上的少量点击与 RGB-D 视频启动,用 SAM2 获得 mask、长程 2D point tracker 维持跨遮挡数据关联,并把深度提升的 tracks 写入对象中心 keypoint map;多假设 SVD / RANSAC、TSDF 评分与 SDF refinement 求每帧 pose,factor graph 与在线 TSDF 维持全局一致性和重建。YCBMultiTrack-Real-World 上 ADD-S / ADD AUC 为 89.40 / 71.19,明显高于 BundleSDF 成功序列均值 62.08 / 42.34;但 HO3D 与 YCBInEOAT 的普通平均并非全面领先,方法依赖纹理、准确 mask、RGB-D 和静态相机,输出也是相对首帧而非 CAD canonical pose。
Tzu-Yuan Lin, Ho Jae Lee, Kevin Doherty, Yonghyeon Lee, Sangbae Kim
方向:物体位姿估计
数据集:HO3D v3 / YCBInEOAT / YCBMultiTrack-Synthetic / YCBMultiTrack-Real-World
指标:ADD-S AUC / ADD AUC / Chamfer Distance
单位:MIT Biomimetic Robotics Lab / Massachusetts Institute of Technology / Boston Dynamics
Pose-VLA: Universal Pose Pretraining for Generalizable Vision-Language-Action Policies
Pose-VLA 以 camera-centric 离散 pose tokens 统一非机器人 3D 标注与机器人末端轨迹:先在 140 万图像、650 万 3D 标注和约 155 万条轨迹上学习 spatial grounding / motion alignment,再接 flow-matching action expert 做少样本 embodiment alignment。论文在 RoboTwin 2.0 Easy / Hard 达到 79.91% / 79.10%,LIBERO 平均 96.0%,真实双臂四任务平均 81.25%。pose prediction 仅是预训练代理任务,部署时不显式输出 pose;深度和 raymap 可被遮蔽以支持 RGB-only 推理。
Haitao Lin, Hanyang Yu, Jingshun Huang, He Zhang, Yonggen Ling, Ping Tan, Xiangyang Xue, Yanwei Fu
方向:VLA / 具身智能
数据集:Omni3D / Omni6DPose / BOP Challenge / AgibotWorld Beta / InternData-A1 / RoboTwin 2.0 / LIBERO
指标:3D grounding AP15 / task success rate
单位:Tencent Robotics X / Futian Laboratory / The Hong Kong University of Science and Technology / Fudan University / Shanghai Innovation Institute
PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning
PoseGAM 将 query 图像和多张带姿态模板送入几何感知的多视角网络,利用显式点几何与学习到的 geometry features 直接预测 pose,避免显式构造 query-template correspondence,并在五个 BOP 数据集上取得平均 AR 提升。
Jianqi Chen, Biao Zhang, Xiangjun Tang, Peter Wonka
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / YCB-V
指标:BOP AR / ARA / ATA / AUC
单位:King Abdullah University of Science and Technology
PoseGaussian: 6D Pose Estimation for Unseen Objects via Sparse-View Object-Level 3D Gaussian Splatting
PoseGaussian 在稀疏 RGB-D 参考视图下重建 object-level 3D Gaussian Splatting 表示,再通过学习引导 ICP 初始化和带外观、深度一致性的可微渲染细化估计未知物体 6D pose。
Wubin Shi, Shaoyan Gai, Feipeng Da
方向:物体位姿估计
数据集:LINEMOD / GenMOP / real-world object scenes
指标:ADD(S)-0.1d / AR / rotation / translation error / inference time
单位:Southeast University
Exploring Category-level Articulated Object Pose Tracking on SE(3) Manifolds
面向类别级可动物体的多帧 6D pose tracking,在 SE(3) / se(3) 中学习位姿增量,结合 weighted PPF 投票、动态关键帧和关节运动学约束降低漂移并提升部件间一致性。
Xianhui Meng, Yukang Huo, Li Zhang, Liu Liu, Haonan Jiang, Yan Zhong, Pingrui Zhang, Cewu Lu, Jun Liu
方向:物体位姿估计
数据集:PM-Videos / ReArt-Videos / RobotArm-Videos / PartNet-Mobility / ReArt-48 / RobotArm
指标:Rotation error / Translation error / 3D IoU / Inference time
单位:University of Science and Technology of China / China Agricultural University / Hefei University of Technology / Zhejiang University of Technology / Fudan University / Shanghai AI Laboratory / Peking University / Shanghai Jiao Tong University
SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D Observation
SCAPO 用 SE(3) 等变 autoencoder、joint-aware blend-skinning、循环重建和 instance residual,从单次 3D 观测联合恢复 canonical geometry、部件与关节状态。合成实验无需 GT 标签;真实数据设置使用分割和关节监督,但不使用 pose 监督。
Can Zhang, Gim Hee Lee
方向:物体位姿估计
数据集:HOI4D / Shape2Motion / real articulated-object RGB-D scans
指标:rotation error / translation error / joint angle error / part segmentation
单位:National University of Singapore
SE(3)-PoseFlow: Estimating 6D Pose Distributions for Uncertainty-Aware Robotic Manipulation
SE(3)-PoseFlow 用 DINOv2 + PointNet++ 编码 RGB-D,DiT* masked cross-attention 条件化 SE(3) rectified flow,直接采样多模态位姿分布,再以 DBSCAN、Chamfer 或 neural SDF 选 pose。REAL275 10°5 cm 为 89.1%,YCB-V / LM-O 为 68.2% / 53.7%;多假设抓取把遮挡杯抓取从 6/10 提到 9/10,但 50 样本、mesh re-ranking 与样本的贝叶斯解释仍是代价。
Yufeng Jin, Niklas Funk, Vignesh Prasad, Zechu Li, Mathias Franzius, Jan Peters, Georgia Chalvatzaki
方向:物体位姿估计
数据集:REAL275 / YCB-Video / LINEMOD-Occlusion / real Franka mug-grasp trials
指标:5°2 cm accuracy / 5°5 cm accuracy / 10°2 cm accuracy / 10°5 cm accuracy / FPS / real-robot grasp success
单位:TU Darmstadt / Honda Research Institute Europe / DFKI / Hessian.AI
SE(3)-Equivariance with Geometric and Topological Guidance for Category-Level Object Pose Estimation
SEGPose 将 SE(3) 等变特征预测与几何、拓扑引导结合,利用点云中的局部结构和全局连接关系增强类别级姿态估计,并进一步验证其对真实机器人抓取的迁移能力。
Sheng Yu, Di-Hua Zhai, Yuanqing Xia
方向:物体位姿估计
数据集:category-level pose benchmarks / robotic grasping scenes
指标:rotation error / translation error / 3D IoU / grasp success
单位:Beijing Institute of Technology / Zhongyuan University of Technology
Category-Level Object Shape and Pose Estimation in Less Than a Millisecond
论文把类别级 shape–pose MAP 条件写成单位四元数上的非线性特征问题,用每步仅需一个 4×4 最小特征向量的 SCF 迭代求局部解,并以拉格朗日对偶检查全局最优性。合成实验单次求解约 0.12 ms,REAL275 求解器约 1.26 ms;数字不含约 50 ms 的前端关键点检测。
Lorenzo Shaikewitz, Tim Nguyen, Luca Carlone
方向:物体位姿估计
数据集:synthetic active-shape benchmark / CAST / NOCS REAL275 / ApolloCar3D
指标:solver runtime / rotation error / translation error / A3DP
单位:MIT Laboratory for Information and Decision Systems / Boston University / MIT SPARK Lab
Simultaneous Extrinsic Contact and In-Hand Pose Estimation via Distributed Tactile Sensing
TacGraph 把双 GelSight 预测的触觉几何、抓内位移与 wrench 写成因子图,并联合约束几何一致性、非穿透、接触运动学和力平衡,同时估计抓内 rest pose、外部接触点与力。触觉单模态接触点误差由 ICP 的 17.53 mm 降至 3.72 mm,3 mm 间隙开环插入成功 23/40;但依赖已知物体 / 环境 mesh、弹性无滑移抓持与单点接触。
Mark Van der Merwe, Kei Ota, Dmitry Berenson, Nima Fazeli, Devesh K. Jha
方向:物体位姿估计
数据集:self-collected GelSight contact-pose benchmark / self-collected tactile-only peg-insertion benchmark
指标:ADD in mm / contact-point error in mm / contact-force error in N / peg-insertion success rate
单位:University of Michigan / Mitsubishi Electric / Mitsubishi Electric Research Laboratories
TwinTrack: Bridging Vision and Contact Physics for Real-Time Tracking of Unknown Objects in Contact-Rich Scenes
TwinTrack 以异步 Real2Sim 从 RGB-D 重建 Gaussian Splats / neural SDF,并用接触轨迹联合修正碰撞几何与物性;在线 Sim2Real 再按视觉匹配质量自适应融合物理一步预测。8 个场景平均 ADD / ADD-S 从视觉基线 3.01 / 1.15 cm 降至 1.23 / 0.59 cm,速度超过 20 Hz,但真值为 FoundationPose 伪标注,且长时无视觉仍会漂移。
Wen Yang, Zhixian Xie, Yiting Wang, Abhijit Tadepalli, Heni Ben Amor, Shan Lin, Wanxin Jin
方向:物体位姿估计
数据集:self-collected impact-rich falling sequences / self-collected LEAP in-hand manipulation sequences
指标:ADD in cm / ADD-S in cm / one-step contact-dynamics prediction error / tracking frequency
单位:Arizona State University / Mohamed bin Zayed University of Artificial Intelligence
VPHO: Joint Visual-Physical Cue Learning and Aggregation for Hand-Object Pose Estimation
面向单 RGB 手-物交互,VPHO 同时学习手/物 heatmap 和接触力等物理线索,先生成多个 diffusion pose 候选,再通过 visual-based 与 physics-based aggregation 选择视觉一致且物理可行的结果。
Jun Zhou, Chi Xu, Kaifeng Tang, Yuting Ge, Tingrui Guo, Li Cheng
方向:物体位姿估计
数据集:DexYCB / HO3Dv2 / DexYCB Phy / HO3Dv2 Phy
指标:MJE / PA-MJE / MCE / OCE / ADD-S / CP / PD / SD
单位:China University of Geosciences / University of Alberta
WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion
WALDO 在 SAM6D 式 model-based novel-object pipeline 上,将 coarse correspondence 同时用于多初始位姿和逐点遮挡 / 背景概率,再以概率引导 dynamic non-uniform dense sampling,并反复用 sparse-to-dense matching 与 weighted SVD 细化。BOP-Core* 五集合上 UAR / AR 为 0.56 / 0.73,主要 baseline SAM6D 为 0.54 / 0.71;单图耗时从 4.37 s 降至 1.53 s。ICBIN UAR 提升最大(0.50→0.56),但 WALDO 的绝对 UAR 仍低于 FRTPose、FreeZe 和 Co-op。论文另按 visibility deciles 定义 UAR,揭示传统 AR 由高可见样本主导;系统仍依赖 RGB-D、精确 CAD、检测分割和较复杂多阶段组件。
Sajjad Pakdamansavoji, Yintao Ma, Amir Rasouli, Tongtong Cao
方向:物体位姿估计
数据集:LM-O (LMO) / T-LESS / TUD-L / IC-BIN / YCB-Video / BOP-Core* five-dataset subset
指标:Unbiased Average Recall (UAR) / BOP Average Recall (AR) / VSD recall / MSSD recall / MSPD recall / visibility-decile mAPD / mARD / per-image inference runtime
单位:Huawei Technologies Canada
XYZ-IBD: Benchmarking Robust 6D Object Pose Estimation under Real-World Industrial Complexity
XYZ-IBD 用 FANUC 机械臂搭载 RealSense、DLP structured-light 与 Photoneo 三类传感器,采集 15 种反光、无纹理、强对称工业件的 75 个高密度料箱场景;ECCV 接收版统计为 22.5K frames、约 273K pose instances,并用消反光喷涂深度、多视角融合、人工粗配准和 multi-scale ICP 建立标签。BOP 6D detection AP 在 XYZ-IBD 上仅为 GDRN 0.266、SurfEmb 0.247、FoundationPose 0.564、SAM6D 0.578,显著低于 BOP-Core 5;但“0.999 mm / 0.432°”精度来自复现噪声与标注流程的仿真误差量化,且项目页仍保留旧版 91K annotations 口径,使用时应以 v3 / ECCV 版并注明计数版本。
Junwen Huang, Jiaqi Hu, Peter KT Yu, Slobodan Ilic, Martin Sundermeyer, Benjamin Busam
方向:物体位姿估计
数据集:XYZ-IBD / BOP Core: LM-O / BOP Core: T-LESS / BOP Core: YCB-V / BOP Core: IC-BIN / BOP Core: TUD-L
指标:BOP 2D detection AP / BOP 6D detection AP / MSSD / MSPD / annotation translation error / annotation angular error / viewpoint calibration RMSE
单位:Technical University of Munich / Munich Center for Machine Learning / XYZ Robotics / ROBOX / Google
You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-Level 9D Multi-Object Pose Estimation
YOPO 把类别、2D box、中心、深度、旋转与各向异性尺度都作为 DETR object query 的一次性输出,并把平移条件化在 box 上、把位姿误差加入 Hungarian matching。微调版本在 REAL275 达 79.6 IoU50 与 54.1 的 10°10 cm;优势是纯 RGB 端到端,细粒度精度仍落后于强 RGB-D 系统。
Hakjin Lee, Junghoon Seo, Jaehoon Sim
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / HouseCat6D
指标:3D IoU at 50% / 75% / 5°2 cm / 5°5 cm / 10°2 cm / 10°5 cm / 10°10 cm / latency
单位:PIT IN Co. AI Robot Team
6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting
以增量式 2D Gaussian Splatting 同时优化对象 pose 与对象表示;动态关键帧选择、图优化和不透明度统计剪枝让模型自由的 RGB-D 6D tracking 与重建能够在线运行。
Yufeng Jin, Vignesh Prasad, Snehal Jauhri, Mathias Franzius, Georgia Chalvatzaki
方向:物体位姿估计
数据集:HO3D / YCBInEOAT
指标:ADD / ADD-S / rotation error / translation error / tracking speed
单位:Technische Universität Darmstadt / Honda Research Institute Europe / Hessian.AI
Any6D: Model-free 6D Pose Estimation of Novel Objects
Any6D 从一张 RGB-D anchor 学习 joint object alignment 与尺度,再通过 render-and-compare 为未知物体选择并细化 pose / size hypothesis。
Taeyeop Lee, Bowen Wen, Minjun Kang, Gyuree Kang, In So Kweon, Kuk-Jin Yoon
方向:物体位姿估计
数据集:REAL275 / Toyota-Light / HO3D / YCBInEOAT / LM-O
指标:AUC ADD / AUC ADD-S / BOP AR / AR_VSD / MSSD / MSPD
单位:KAIST / NVIDIA
Betsu-Betsu: Multi-View Separable 3D Reconstruction of Two Interacting Objects
Betsu-Betsu 用共享 multi-resolution hash grid 表征交互场景,再解码出对象各自的 SDF 与 radiance field;alpha-blending regularization 在互遮挡边界抑制两份几何互相穿插。
Suhas Gopal, Rishabh Dabral, Vladislav Golyanik, Christian Theobalt
方向:3D 表示 / 重建
数据集:Betsu-Betsu human-object dataset / WildRGB-D / AffordPose / NeuralDome / ReMoCap
指标:Chamfer Distance / F-score@1cm / PSNR / SSIM / LPIPS / 3D IoU
单位:Saarland University / Max Planck Institute for Informatics
BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation
用稀疏参考 RGB 图像恢复物体 3D bounding box,并预测 query 视角下的 2D box corners,再通过 PnP 估计 unseen object 的 6D pose,强调稀疏视角和遮挡场景下的泛化能力。
Yuanhong Yu, Xingyi He, Chen Zhao, Junhao Yu, Jiaqi Yang, Ruizhen Hu, Yujun Shen, Xing Zhu, Xiaowei Zhou, Sida Peng
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD / YCB-Video / OnePose / OnePose-LowTexture / Objaverse
指标:ADD / ADD-S / ADD(s)-0.1d / Proj2D@5px / ADD-AUC / ADD-S AUC
单位:Zhejiang University / Xiangjiang Laboratory / Ant Group / EPFL / Chongqing University / Northwestern Polytechnical University / Shenzhen University
CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image
CAP-Net 以单阶段 RGB-D 网络共同预测 part class、中心偏移与 NPCS,并在 RGBD-Art 上面向类别级可动部件恢复 pose、size 和关节状态。
Jingshun Huang, Haitao Lin, Tianyu Wang, Yanwei Fu, Xiangyang Xue, Yi Zhu
方向:物体位姿估计
数据集:RGBD-Art / synthetic articulated-object benchmarks
指标:part AP50 / 5° 5cm / rotation error / translation error / size error
单位:Fudan University / Huawei Noah’s Ark Lab
CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models
以 query image 与关键点文本描述替代传统 support images 和标注,通过 MLLM 的视觉语言 token、dynamic round training 与灵活坐标解码完成类别无关 keypoint pose;它不是 BOP-style 6D pose。
Junho Kim, Hyungjin Chung, Byung-Hoon Kim
方向:物体位姿估计
数据集:MP-100
指标:PCK@0.2 / PCK@0.1 / 1-shot accuracy / 5-shot accuracy
单位:EverEx / Yonsei University
A Unified End-to-End Network for Category-Level and Instance-Level Object Pose Estimation from RGB Images
CIPE 将类别级与实例级 RGB pose 统一为 set prediction,引入欧氏空间中的 learnable rotation representation,并用 prior-query fusion 将类别点云先验注入 bounding-box queries;公开 GitHub 当前仍是占位仓库,暂无可运行代码。
Jiale Ren, Hong Liu, Jinfu Liu, Peifeng Jiang
方向:物体位姿估计
数据集:Category-level RGB pose benchmark / Instance-level RGB pose benchmark
指标:rotation / translation pose accuracy / category-level and instance-level protocol
单位:Peking University
CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation
以 front-door adjustment 缓解类别级 pose 的数据偏置,并用 3D foundation model 的残差知识蒸馏补充无偏语义,在 RGB-D 9DoF pose 与 size 估计上验证跨实例泛化。
Xiao Lin, Yun Peng, Liuyi Wang, Xianyou Zhong, Minghao Zhu, Yi Feng, Jingwei Yang, Chengju Liu, Qijun Chen
方向:物体位姿估计
数据集:REAL275 / CAMERA25 / HouseCat6D
指标:3D IoU / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:Tongji University / State Key Laboratory of Autonomous Intelligent Unmanned Systems
Co-op: Correspondence-based Novel Object Pose Estimation
Co-op 用少量 CAD 渲染模板建立半稠密对应,再以分类+offset 的混合表示、概率 flow 与可微 PnP 完成未知物体的 coarse-to-fine 6D pose 估计。
Sungphill Moon, Hyeontae Son, Dongcheol Hur, Sangwook Kim
方向:物体位姿估计
数据集:BOP: LM-O / T-LESS / TUD-L / IC-BIN / ITODD / YCB-V / HB
指标:BOP AR / AR_VSD / AR_MSSD / AR_MSPD / runtime
单位:NAVER LABS
CRISP: Object Pose and Shape Estimation with Test-Time Adaptation
CRISP 联合估计隐式形状与 pose-normalized points,并将 active shape model corrector 变成可认证的伪标签生成器,在测试时自训练缓解大域差距。
Jingnan Shi, Rajat Talak, Harry Zhang, David Jin, Luca Carlone
方向:物体位姿估计
数据集:YCB-Video / SPE3R / NOCS-REAL275
指标:ADD-S / ADD-S AUC / Chamfer distance / mAP
单位:MIT Laboratory for Information & Decision Systems (LIDS)
Deterministic Object Pose Confidence Region Estimation
以确定性 Gaussian keypoint regression 和 inductive conformal prediction 先构造 2D 可信区域,再由 implicit function theorem 传播到 6D pose 可信区域,避免采样式 UQ 的高时延和区域膨胀。
Jinghao Wang, Zhang Li, Zi Wang, Banglei Guan, Yang Shang, Qifeng Yu
方向:物体位姿估计
数据集:Occlusion LINEMOD / SPEED
指标:coverage rate / confidence region volume / ADD(-S) / runtime
单位:National University of Defense Technology / Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation
Distilling 3D Distinctive Local Descriptors for 6D Pose Estimation
dGeDi 将 FreeZe 中逐点计算、依赖局部参考系的 GeDi 描述子蒸馏到 PTV3;它用真值 pose 把 CAD query teacher features 转移到 noisy partial target,并以低误差优先的分段损失抑制非显著教师点,使几何特征提取从 3.284 s 降至 0.019 s,同时保持或略升五个 BOP 数据集的平均 pose AR。
Amir Hamza, Andrea Caraffa, Davide Boscaini, Fabio Poiesi
方向:特征匹配 / 对应关系
数据集:MegaPose-ShapeNetCore / LM-O / T-LESS / TUD-L / IC-BIN / YCB-V
指标:Ratio of Nearest points / Feature Matching Recall / BOP Average Recall / feature extraction runtime
单位:Fondazione Bruno Kessler / University of Trento
High-Precision Object Pose Estimation Using Visual-Tactile Information for Dynamic Interactions in Robotic Grasping
该工作以 particle filter 融合视觉和触觉位移:视觉实时追踪被接触对象,触觉修正抓持对象的滑移与 pose change;摘要在 13 个不同几何对象上验证动态适应性,但未披露 cm / degree 误差。
Zicai Peng, Te Cui, Guangyan Chen, Haoyang Lu, Yi Yang, Yufeng Yue
方向:物体位姿估计
数据集:13-object dynamic interaction test
指标:translation error / rotation error / dynamic tracking robustness
单位:Beijing Institute of Technology
DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects
DynamicPose 用 VIO 消除 camera ego-motion 引起的 ROI 与旋转变化,以 2D bbox 中心和 median depth 补偿对象自身大平移,再由世界坐标系中的 Kalman covariance 自适应生成 1–27 个旋转候选,交给 FoundationPose refiner 分层筛选并闭环更新下一帧;在 13 个 YCB 对象的高速 Isaac Sim 轨迹上取得 88.9 / 75.8 的平均 ADD-S / ADD AUC。
Tingbang Liang, Yixin Zeng, Jiatong Xie, Boyu Zhou
方向:物体位姿估计
数据集:YCB-Video objects in Isaac Sim / custom real-world mobile-manipulator sequence
指标:ADD AUC at 0.1 m / ADD-S AUC at 0.1 m / tracking frequency
单位:Sun Yat-Sen University / Xi’an Jiaotong University / Southern University of Science and Technology / Differential Robotics
EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting
EgoGaussian 先由静态片段初始化背景与对象 Gaussians,再在动态片段中交替优化 rigid object pose 与 Gaussian densification,最后联合微调得到带每帧对象位姿的第一视角 4D scene representation。
Daiwei Zhang, Gengyan Li, Jiajie Li, Mickaël Bressieux, Otmar Hilliges, Marc Pollefeys, Luc Van Gool, Xi Wang
方向:3D 表示 / 重建
数据集:HOI4D / EPIC-KITCHENS
指标:PSNR / SSIM / LPIPS
单位:ETH Zürich / Google / Microsoft / KU Leuven / INSAIT, Sofia
Environment-Agnostic Pose: Generating Environment-independent Object Representations for 6D Pose Estimation
EA6D 通过 VAE 与 Environment Decoupling Diffusion Model 生成对背景、光照和遮挡更不敏感的对象表示,再解码 rotation 与 translation,目标是仅以合成训练降低真实环境域差。
Shaobo Zhang, Yuhang Huang, Wanqing Zhao, Wei Zhao, Ziyu Guan, Jinye Peng
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD / YCB-Video / DiverseScenes
指标:ADD(-S) / 2D Projection / rotation error / translation error
单位:Northwest University / National University of Defense Technology / Xidian University
6-DoF Object Tracking with Event-based Optical Flow and Frames
该方法以局部事件三元组生成逐事件 2D optical flow,并通过依赖 pixel depth 的 interaction matrix 在 KF 中恢复对象 6D velocity;quaternion UKF 再融合 5 Hz DOPE absolute pose。它在四个 YCB 对象的高速合成轨迹上显著优于帧光流与 RGB-D tracker,但真实双相机序列无真值,实验也均为离线。
Zhichao Li, Arren Glover, Chiara Bartolozzi, Lorenzo Natale
方向:物体位姿估计
数据集:custom Unreal Engine YCB sequences / custom real event / RGB-D sequences
指标:position RMSE / rotation RMSE
单位:Istituto Italiano di Tecnologia / University of Genoa
Multi-Layer Feature Exchange Transformer for Multi-View 6D Object Pose Estimation in Robot Bin Picking
该方法在 EpiSurfEmb 上加入 multi-layer Feature Exchange Transformer,以 self-attention、epipolar cross-attention 和 coarse-to-fine 调度提前交换多视角特征,而非只在 pose 末端融合;摘要称 ROBI 上优于 baseline 与多视角 SOTA,但未披露数值。
Momen Khalil, Vincent Dietrich, Slobodan Ilic
方向:物体位姿估计
数据集:ROBI
指标:BOP Average Recall / multi-view 6D pose accuracy
单位:Technical University of Munich / Siemens AG
GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation
GCE-Pose 先通过 semantic shape reconstruction 补齐部分可见实例的全局语义几何,再融合重建上下文和观测特征预测 NOCS 与类别级 pose。
Weihang Li, Hongli Xu, Junwen Huang, Hyunjun Jung, Peter K. T. Yu, Nassir Navab, Benjamin Busam
方向:物体位姿估计
数据集:HouseCat6D / NOCS-REAL275
指标:5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm / 3D IoU
单位:Technical University of Munich / Munich Center for Machine Learning / XYZ Robotics
Generalizable Single-View Object Pose Estimation by Two-Side Generating and Matching
Gen2SM 面向未见物体的一参考—一查询相对方向估计:以已知 reference pose 和重力对齐为前提,用 Zero-1-to-3 从参考侧生成 64 个上半球中间视角,再让查询条件解释这些图像的加噪 latent,以 Monte-Carlo 去噪残差构造 two-side pose score,经过网格搜索与 SGD 细化恢复 elevation / azimuth。NAVI 上 15° / 30° rotation accuracy 为 55.32 / 82.14,GSO 为 58.26 / 72.61;但方法不估 translation、scale 或独立 roll,默认单张 A100 约需 6.5 s 搜索 + 1.3 s 细化。
Yujing Sun, Caiyi Sun, Yuan Liu, Yuexin Ma, Siu Ming Yiu
方向:物体位姿估计
数据集:NAVI / Google Scanned Objects (GSO)
指标:rotation accuracy within 15 degrees / rotation accuracy within 30 degrees / large-viewpoint rotation accuracy / inference runtime
单位:The University of Hong Kong / ShanghaiTech University
GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation
GIVEPose 用与 NOCS 互补的 IVFC coordinate map 表示类别共识形状,通过 DCAE 逐步压制实例内变化,强化纯 RGB 的类别级 pose fitting。
Ziqin Huang, Gu Wang, Chenyangguang Zhang, Ruida Zhang, Xiu Li, Xiangyang Ji
方向:物体位姿估计
数据集:NOCS-REAL275 / CAMERA25 / Wild6D
指标:N IoU / 10° 0.2d / 10° 0.5d / 5° 5cm
单位:Tsinghua University / Pengcheng Laboratory
Leveraging Global Stereo Consistency for Category-Level Shape and 6D Pose Estimation from Stereo Images
该方法把类别内 occupancy field 当作跨视图统一形状,以 global stereo consistency 约束 shape、scale 与 pose 的耦合优化,面向深度传感不可靠的材质。
Junning Qiu, Minglei Lu, Fei Wang, Yu Guo, Yonggen Ling
方向:物体位姿估计
数据集:TOD / S-RGBD
指标:3D_avg / 3D IoU / 5° 5cm / grasp success
单位:Xi’an Jiaotong University / Tencent Robotics X
GS-Pose: Generalizable Segmentation-Based 6D Object Pose Estimation With 3D Gaussian Splatting
GS-Pose 从新物体的少量有位姿 RGB reference views 构建语义、rotation-aware 和 3D Gaussian 三种表示,依次完成内置对象定位、template retrieval 的初始 pose 与 3DGS render-and-compare refinement。
Dingding Cai, Janne Heikkilä, Esa Rahtu
方向:物体位姿估计
数据集:LINEMOD / OnePose-LowTexture
指标:ADD(S)@0.1d / Proj@5pix / mAP@[0.5:0.95]
单位:Tampere University / University of Oulu
Generalizable Zero-Shot Object Pose Estimation for Bin-Picking
GZS6D-BP 先实时渲染 CAD templates 完成粗位姿,再以相机视角对齐的 semantic point-pair features 精修,无需为新工件重训;其公开 BOP coarse+refine+teaser 提交在七个 Classic-Core 数据集取得 AR 0.717,平均 6.516 s/image。
Zijiang Zhang, Huimin Lu, Jintong Cai, Tohru Kamiya, Seiichi Serikawa
方向:物体位姿估计
数据集:BOP core datasets (7) / Real-world bin-picking system
指标:BOP Average Recall / runtime / robotic grasping precision
单位:Kyushu Institute of Technology / Nantong University
HOGSA: Bimanual Hand-Object Interaction Understanding with 3D Gaussian Splatting Based Data Augmentation
HOGSA 用 mesh-based 3D Gaussian Splatting 与超分辨率渲染构造高质量双手—物体训练样本,并以双手抓取 pose 优化扩充视角和姿态覆盖,提升交互 pose 基线。
Wentian Qu, Jiahe Li, Jian Cheng, Jian Shi, Chenyu Meng, Cuixia Ma, Hongan Wang, Xiaoming Deng, Yinda Zhang
方向:物体位姿估计
数据集:ARCTIC / H2O
指标:CDev / MRRPE / MPJPE / AAE / success rate / PSNR / SSIM / LPIPS
单位:Institute of Automation, Chinese Academy of Sciences / University of Chinese Academy of Sciences / Google
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views
iFusion 将 Zero123 novel-view diffusion model 反演为两张未知相机位姿物体图像之间的 SE(3) view-pose optimizer,再用自估位姿进行 LoRA 微调与后续 NeRF/3DGS 等重建模块的几何指导。
Chin-Hsuan Wu, Yen-Chun Chen, Bolivar Solarte, Lu Yuan, Min Sun
方向:3D 表示 / 重建
数据集:Google Scanned Objects / OmniObject3D
指标:rotation error / translation error / 5° pose recall / PSNR / SSIM / LPIPS / Chamfer Distance / Volumetric IoU
单位:National Tsing Hua University / Microsoft / Amazon
iG-6DoF: Model-free 6DoF Pose Estimation for Unseen Object via Iterative 3D Gaussian Splatting
iG-6DoF 先用多尺度旋转等变特征构造初始 pose,再以对象 3D Gaussian Splatting 的 iterated render-and-compare 细化未知物体姿态。
Tuo Cao, Fei Luo, Jiongming Qin, Yu Jiang, Yusen Wang, Chunxia Xiao
方向:物体位姿估计
数据集:LINEMOD / OnePose-LowTexture / GenMOP / BOP LM
指标:ADD(S)-0.1d / Projection 2D / BOP AR_VSD / MSSD / MSPD
单位:Wuhan University
InterTrack: Tracking Human Object Interaction without Object Templates
InterTrack 用 CorrAE 为逐帧人形重建建立 SMPL correspondence,用 TOPNet 在时序与人体条件下预测遮挡物体 rotation,再联合优化 canonical object shape、逐帧变换与人—物接触。
Xianghui Xie, Jan Eric Lenssen, Gerard Pons-Moll
方向:物体位姿估计
数据集:ProciGen-Video / BEHAVE / InterCap
指标:F-score@1cm / Chamfer Distance / correspondence time
单位:University of Tübingen / Tübingen AI Center / Max Planck Institute for Informatics
JENGA: Object Selection and Pose Estimation for Robotic Grasping from a Stack
JENGA 在 YOLOv8 + ZebraPose 候选上,以 IMU 重力方向排序对象高度,并用观测 modal mask 与 pose-rendered amodal mask 的面积比筛除遮挡砖块。合成 top-1 的自定义 precision-mAP 为 0.79;该指标不含 recall,真实 Yaskawa 工地部署也只有视频、没有抓取成功率。
Sai Srinivas Jeevanandam, Sandeep Inuganti, Shreedhar Govil, Didier Stricker, Jason Rambach
方向:物体位姿估计
数据集:JENGA synthetic stacked-brick dataset / custom real construction-site deployment
指标:AP over ADD-S thresholds / AP over MSSD thresholds / mean precision-AP
单位:German Research Center for Artificial Intelligence (DFKI) / RPTU Kaiserslautern
KeyPose: Category-Level 6D Object Pose Estimation with Self-Adaptive Keypoints
KeyPose 让关键点随对象几何自适应生成,再经关键点—关键点与关键点—点云图聚合,并用 NOCS voxelization 回归 canonical keypoints,从结构层面缓解类别内形状变化。
Sheng Yu, Di-Hua Zhai, Yuanqing Xia
方向:物体位姿估计
数据集:CAMERA25 / NOCS-REAL275 / HouseCat6D
指标:3D IoU / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:Beijing Institute of Technology / Zhongyuan University of Technology
Visuo-Tactile Object Pose Estimation for a Multi-Finger Robot Hand with Low-Resolution In-Hand Tactile Sensing
该方法把视觉 pose、手部本体感觉、每指节二值接触和 non-penetration prior 统一进 factor graph,以 robust cost 在手部严重遮挡或视觉噪声下优化抓持对象 pose。
Lukas Mack, Felix Grüninger, Benjamin A. Richardson, Regine Lendway, Katherine J. Kuchenbecker, Joerg Stueckler
方向:物体位姿估计
数据集:17 YCB objects in simulation / ISyHand real grasp sequences
指标:ADD-S / runtime / update rate
单位:University of Augsburg / Max Planck Institute for Intelligent Systems
Improving 6D Object Pose Estimation of Metallic Household and Industry Objects
论文发布 60 个金属罐、家居用品和工业零件组成的 IGD BOP-compatible 合成数据集;一条 GDRNPP 扩展预测曲率关键点热图并以 BAM 融合,另一条学习弱化 metallic / specular 影响的差分图并二次送入 GeoHead。两者分别提升合成测试 AR,但未联合训练,也没有真实图像验证。
Thomas Pöllabauer, Michael Gasser, Tristan Wirth, Sarah Berkei, Volker Knauthe, Arjan Kuijper
方向:物体位姿估计
数据集:IGD metallic object pose dataset
指标:BOP Average Recall / ARVSD / ARMSSD / ARMSPD / AD(0.1) / rotation symmetry error / translation symmetry error
单位:Technical University Darmstadt / Fraunhofer IGD / Threedy GmbH
MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation
直接融合多个参考视图中同一 3D 点的特征和遮挡状态,再以 RANSAC-PnP 恢复 pose;目标是在 BOP 新物体设定下减少 reference 数、内存和推理开销。
Xinhang Liu, Jiawei Shi, Zheng Dang, Yuchao Dai
方向:物体位姿估计
数据集:BOP core datasets / GSO-Datasets
指标:BOP AR / inference speed / network parameters / reference image count
单位:Northwestern Polytechnical University / Shaanxi Key Laboratory of Information Acquisition and Processing / EPFL CVLab
MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning
MK-Pose 融合冻结 DINOv2 的 RGB、PointNet++ 点云与 GPT-4o 形状描述的 CLIP 文本特征,以 soft heatmap 和 GAT 在无人工关键点坐标下发现 96 个三维关键点,再聚合 KNN 局部几何与全局上下文,并用 NOCS、重建和有限 / 无限对称损失联合回归类别级 pose 与尺寸。
Yifan Yang, Peili Song, Enfan Lan, Dong Liu, Jingtai Liu
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / HouseCat6D
指标:3D IoU25 / IoU50 / IoU75 / 5°/2cm AP / 10°/2cm AP / 10°/5cm AP
单位:Nankai University
MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model
MonoDiff9D 从单张 RGB 以 DINOv2 恢复粗点云,将图像 / 点云全局特征和 timestep 编码作为条件,用 Transformer denoiser 从高斯噪声生成旋转、平移与尺度。
Jian Liu, Wei Sun, Hui Yang, Jin Zheng, Zichen Geng, Hossein Rahmani, Ajmal Mian
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / Wild6D
指标:3D IoU / n° mcm / mAP
单位:Hunan University / Central South University / Lancaster University / The University of Western Australia
Occlusion-Aware 6D Pose Estimation with Depth-Guided Graph Encoding and Cross-Semantic Fusion for Robotic Grasping
ICRA 2025 Best Conference Paper Finalist:以 depth-guided GNN 建模遮挡下非相邻表面点关系,并自适应融合 mask 与 binary code,增强 RGB-D 场景中的 2D–3D correspondence;摘要报告 LM-O / YCB-V 相对提升 1.2% / 1.9%,个别对象最高 30%。
Jingyang Liu, Zhenyu Lu, Lu Chen, Jing Yang, Chenguang Yang
方向:物体位姿估计
数据集:LM-Occlusion / YCB-Video / Real-world robotic grasping test
指标:ADD(-S) / ADD(-S) AUC
单位:Shanxi University / Taiyuan University of Science and Technology / Bristol Robotics Laboratory / University of Liverpool
OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB
OmniPose6D 用 4,000+ OmniObject3D 网格生成 4 万条、每条 100 帧的动态合成序列;其 baseline 在首帧 mask 上采 CoTracker 点轨迹,以五档像素误差训练 uncertainty-aware refinement,筛选共视点后由 COLMAP 在 8 帧短窗中恢复相对首帧、up-to-scale 的对象运动。评测需 7-DoF 真值对齐,RTX 3090 上每窗口约 10 秒。
Yunzhi Lin, Yipu Zhao, Fu-Jen Chu, Xingyu Chen, Weiyao Wang, Hao Tang, Patricio A. Vela, Matt Feiszli, Kevin Liang
方向:物体位姿估计
数据集:OmniPose6D / HO3D v3 / YCBInEOAT / DexYCB
指标:KITTI translation error threshold AP / KITTI rotation error threshold AP / ATE threshold AP after 7-DoF alignment / RPE translation / rotation threshold AP
单位:Meta / Georgia Institute of Technology
OmniShape: Zero-Shot Multi-Hypothesis Shape and Pose Estimation in the Real World
OmniShape 用两个条件 diffusion models 分别采样 partial NORF point cloud 与 triplanar shape completion,再以 depth registration 将多组 pose–shape hypotheses 放回真实场景。
Katherine Liu, Sergey Zakharov, Dian Chen, Takuya Ikeda, Greg Shakhnarovich, Adrien Gaidon, Rares Ambrus
方向:3D 表示 / 重建
数据集:Ocrtoc3D / Pix3D / TYO-L / NOCS REAL275 / HOPE / TUM RGB-D
指标:Chamfer-L1 / F1 score / best-of-N hypothesis quality
单位:Toyota Research Institute / Woven by Toyota / Toyota Technological Institute at Chicago
ONDA-Pose: Occlusion-Aware Neural Domain Adaptation for Self-Supervised 6D Object Pose Estimation
ONDA-Pose 先从真实无标签图像拟合 CAD-like radiance field,再以全局 pose refiner 生成伪标签并联合渲染合成图进行遮挡感知的自监督域适应。
Tao Tan, Qiulei Dong
方向:物体位姿估计
数据集:LINEMOD / Occluded LINEMOD / HomebrewedDB
指标:ADD(-S) / ADD-S AUC / 2D projection error
单位:University of Chinese Academy of Sciences / CASIA
One2Any: One-Reference 6D Pose Estimation for Any Object
One2Any 将单 reference RGB-D 编码成 ROPE,再针对 query 解码 Reference Object Coordinate,以连续的相对坐标表示替代多视图检索和 CAD 对齐。
Mengya Liu, Siyuan Li, Ajad Chhatkuli, Prune Truong, Luc Van Gool, Federico Tombari
方向:物体位姿估计
数据集:REAL275 / Toyota-Light / YCB-Video / LINEMOD
指标:ADD-S AUC / ADD AUC / BOP AR / tracking AUC / inference time
单位:ETH Zurich / INSAIT / Sofia University / Google / Technical University of Munich
PACA: Perspective-Aware Cross-Attention Representation for Zero-Shot Scene Rearrangement
PACA 把 Stable Diffusion 的生成、对象区域提取与特征编码合并为 word-conditioned cross-attention representation:目标侧直接生成,真实 RGB 侧经 DDIM inversion / reconstruction 后在同一 denoising timeline 读取对象表示,再以 ICP、Marigold 相对深度与 RGB-D 对齐计算重排变换。450 对 real–generated images 上平均 matching accuracy 为 86.72%,高于 DALL·E-Bot 的 51.35%;60 次真实机器人实验中 3-DoF / 6-DoF 设置平均成功率为 68.73% / 65.56%。正文对象变换明确写作 (x,y,z,θ),成功判据是相对布局而非 pose GT,因此它是生成目标驱动的机器人扩展系统,不是完整 SE(3) 物体位姿 benchmark。
Shutong Jin, Ruiyu Wang, Kuangyi Chen, Florian T. Pokorny
方向:机器人感知与操作
数据集:PACA Dining Scene / PACA Fruit Scene / PACA Office Scene / 450 real–generated image pairs / 60 real-robot rearrangement trials
指标:object matching accuracy / robot execution success rate / Inception Score / CLIP Score / human goal-satisfaction rating
单位:KTH Royal Institute of Technology / Graz University of Technology
PartPose: Attentive 6D Pose Estimation by Focusing on Graspable Parts of Multi-Part Deformable Objects
PartPose 面向袋装饮品、线缆连接电器和带绳物体等“刚柔混合”目标:以 DINOv2 转移参考关键点、SAM 分割可抓取刚性 ROI,并用 Bayesian optimization 选择 ROI 几何,再交给 FoundationPose 做局部 render-and-compare。九个对象上整体平移 / 旋转成功率为 98.2% / 96.4%,真实抓取成功率 87.2%;但它依赖 CAD、RGB-D、人工参考点和可见刚性部件,不能处理全柔性目标。正式出版物是 RA-L 2025,ICRA 2026 仅为期刊论文现场报告。
Ryo Okumura, Tadahiro Taniguchi
方向:物体位姿估计
数据集:PartPose multi-part deformable object dataset
指标:translation success rate at 30 mm / rotation success rate at 0.3 rad / robotic picking success rate / translation error / rotation error / inference latency
单位:Panasonic Holdings Corporation / Kyoto University / Ritsumeikan University
Category-Level 6D Object Pose Estimation in Agricultural Settings Using a Lattice-Deformation Framework and Diffusion-Augmented Synthetic Data
PLANTPose 用 24D cubic B-spline lattice 显式表示类别实例形变,借助 Umeyama 去除形变中的刚体分量,再以 Blender 物理场景和 depth-conditioned Stable Diffusion 构造训练图;small ViT 从 RGB 联合预测 rotation、deformation 与投影,PnP 恢复相机坐标系 translation。
Marios Glytsos, Panagiotis P. Filntisis, George Retsinas, Petros Maragos
方向:物体位姿估计
数据集:PLANTPose banana benchmark / PLANTPose synthetic training set
指标:Chamfer distance / mean / median rotation error / mean / median translation error / deformation error
单位:Robotics Institute, Athena Research and Innovation Center / National Technical University of Athens
Pos3R: 6D Pose Estimation for Unseen Objects Made Easy
Pos3R 将 3D reconstruction foundation model 的 3D-consistent feature 接入 template selection 与对应关系估计,在无需 pose-specific training 下处理未知物体。
Weijian Deng, Dylan Campbell, Chunyi Sun, Jiahao Zhang, Shubham Kanitkar, Matthew E. Shaffer, Stephen Gould
方向:物体位姿估计
数据集:BOP: YCB-V / LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HB
指标:BOP AR / AR_VSD / AR_MSSD / AR_MSPD
单位:Australian National University / RIOS Intelligent Machines
QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects
QORT-Former 用 left-hand / right-hand / object 分区 query、query proposal loss 与 contact feature,在单张 RGB 中实时联合估计双手与物体 3D pose,并兼顾交互识别。
Elkhan Ismayilzada, MD Khalequzzaman Chowdhury Sayem, Yihalem Yimolal Tiruneh, Mubarrat Tajoar Chowdhury, Muhammadjon Boboev, Seungryul Baek
方向:物体位姿估计
数据集:H2O / First-Person Hand Action (FPHA)
指标:mean end-point error / Top-1 accuracy / FPS
单位:Ulsan National Institute of Science and Technology / Michigan State University
R²-Art: Category-Level Articulation Pose Estimation from Single RGB Image via Cascade Render Strategy
R²-Art 用单张 RGB 并行估计 root pose 与关节状态,以 joint-centric prior 对各部件做变换 / 形变,再通过级联渲染损失逐步校正可动部件的类别级 pose。
Li Zhang, Haonan Jiang, Yukang Huo, Yan Zhong, Jianan Wang, Xue Wang, Rujing Wang, Liu Liu
方向:物体位姿估计
数据集:ArtImage / ReArtMix / RobotArm
指标:ADD / AUC / 3D IoU
单位:Hefei Institutes of Physical Science, Chinese Academy of Sciences / University of Science and Technology of China / Astribot / Zhejiang University of Technology / China Agricultural University / Peking University / Hefei University of Technology
RAG-6DPose: Retrieval-Augmented 6D Pose Estimation via Leveraging CAD as Knowledge Base
RAG-6DPose 将 CAD 多视角渲染的 DINOv2 外观投回三维点,并与坐标、颜色组成逐对象 memory;查询 RGB 通过 ReSPC 的 self-attention、PointNet 与 cross-attention 检索相关 CAD 点,随后以 SurfEmb 式 InfoNCE 学习 dense 2D–3D correspondence,经 PnP-RANSAC 和可选 ICP 输出 pose。
Kuanning Wang, Yuqian Fu, Tianyu Wang, Yanwei Fu, Longfei Liang, Yu-Gang Jiang, Xiangyang Xue
方向:物体位姿估计
数据集:LM-O / IC-BIN / TUD-L / YCB-V / HB
指标:BOP Average Recall / ARVSD / ARMSSD / ARMSPD / robot task success rate
单位:Fudan University / INSAIT, Sofia University / NeuhHelium Co., Ltd.
Shape-Biased Texture Agnostic Representations for Improved Textureless and Metallic Object Detection and 6D Pose Estimation
本文不改 GDR-Net、Pix2Pose 或检测器结构,而是在 BlenderProc PBR 渲染时从 1,226 张纹理中随机采样并 UV-map 到对象表面,削弱 CNN 对固定颜色与材质的依赖。完整 shape-biased 检测—位姿链路在 T-LESS 上将 GDR-Net / Pix2Pose 的 BOP AR 从 56.29 / 46.68 提至 58.32 / 50.13,在 ITODD 上从 10.70 / 12.90 提至 11.10 / 15.30;Gaussian noise、shot noise 与 brightness 下更稳,但 motion / Gaussian blur 基本不改善。收益依赖 detector 与 online augmentation,且 CAD + shape bias 的 62.95 AR 明显高于 reconstructed mesh + shape bias 的 46.57,说明随机纹理不能替代准确几何。
Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel, Matthias Hirschmanner, Markus Vincze
方向:物体位姿估计
数据集:T-LESS / ITODD
指标:BOP Average Recall / MSPD Average Recall / MSSD Average Recall / VSD Average Recall / COCO detection mAP / image-perturbation robustness
单位:TU Wien / UAS Technikum Vienna
RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation
把 template-based pose estimation 重写为 object-centered camera-ray alignment:diffusion transformer 条件于多视角已知姿态模板,对结构化 rotation/translation maps 去噪并完成 coarse-to-fine 推理。
Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu, Nassir Navab, Slobodan Ilic, Benjamin Busam
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD / YCB-Video / T-LESS
指标:ADD(-S) Recall / BOP AR / rotation error / translation error
单位:Technical University of Munich / Munich Center for Machine Learning / XYZ Robotics
RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance
RCGNet 用冻结 DINOv2 从 RGB crop 预测并融合外观与几何特征,以训练期真实 NOCS 点云特征进行几何引导,再结合类别先验形变、尺度分支与 RANSAC-PnP 恢复类别级 pose;推理输入不含深度,但仍依赖类别点云、mask 和训练期几何监督。
Sheng Yu, Di-Hua Zhai, Yuanqing Xia
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / Wild6D
指标:3D IoU50 / 3D IoU75 / 10 cm mAP / 10° mAP / 10°10 cm mAP
单位:Beijing Institute of Technology / Zhongyuan University of Technology
Comparative Evaluation of 3D Reconstruction Methods for Object Pose Estimation
该 benchmark 为 YCB-V 21 个实物采集每对象 397–505 张标定高分辨率多视图,比较 COLMAP、RealityCapture、Nerfacto、VolSDF、MonoSDF、BakedSDF 等 reconstruction 接入 MegaPose / FoundationPose 后的 BOP AR。结果显示 geometry completeness / accuracy、PSNR 与下游 pose 排名并不等价;最佳重建相对 CAD 通常仍有约 10%–20% 差距,RealityCapture 与 Nerfacto 具有较好的准确率—耗时折中,多数方法在 75–100 张图附近接近完整数据表现。困难主要集中于小型、反光、细纹理和实物版本变化的对象;benchmark 注册仍使用 CAD 与人工粗对齐初始化 ICP,因此不是完整无 CAD onboarding。
Varun Burde, Assia Benbihi, Pavel Burget, Torsten Sattler
方向:3D 表示 / 重建
数据集:YCB-Video / Reconstruction Pose Benchmark for 21 YCB-V objects
指标:BOP Average Recall / VSD recall / MSSD recall / MSPD recall / geometry completeness / geometry accuracy / PSNR / reconstruction runtime / image-count efficiency
单位:Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague
Recurrent Feature Mining and Keypoint Mixup Padding for Category-Agnostic Pose Estimation
该工作面向 category-agnostic keypoint pose:用递归 deformable attention 挖掘 support/query 的细粒度结构特征,并用 mixup keypoint padding 统一可变关键点数量。
Junjie Chen, Weilong Chen, Yifan Zuo, Yuming Fang
方向:物体位姿估计
数据集:MP-100
指标:mPCK / PCK@0.05 / 1-shot / 5-shot accuracy
单位:Jiangxi University of Finance and Economics
RefPose: Leveraging Reference Geometric Correspondences for Accurate 6D Pose Estimation of Unseen Objects
RefPose 用 reference geometric correspondence 构造初始 pose,并以 correlation-volume-guided attention 驱动 render-and-compare 细化,减少未知物体的固定模型依赖。
Jaeguk Kim, Jaewoo Park, Keuntek Lee, Nam Ik Cho
方向:物体位姿估计
数据集:BOP: YCB-V / LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HB
指标:BOP AR / AR_VSD / AR_MSSD / AR_MSPD / runtime
单位:Seoul National University / INMC / IPAI
RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking
RGBTrack 用真实尺度 CAD 的 rendered-mask 面积与观测 mask 面积做二分搜索,替代首帧 median depth;后续把 FoundationPose point-cloud channels 置零,仅用 RGB 与上一帧 pose refine,并由 XMem、Kalman 与状态机在中心 / 面积异常时采 20 个候选恢复。未知 CAD scale 的 metric recovery 仍需首帧 true depth。
Teng Guo, Jingjin Yu
方向:物体位姿估计
数据集:YCBInEOAT / ClearPose
指标:BOP Average Recall / translation error / rotation error / tracking FPS
单位:Rutgers, The State University of New Jersey
RoMa v2: Harder Better Faster Denser Feature Matching
RoMa v2 是面向视觉定位、SfM、重建和位姿估计下游任务的稠密特征匹配器,用 DINOv3、多视图 Transformer、轻量 refinement 和预测 covariance 提升困难场景下的匹配精度、速度和泛化性。
Johan Edstedt, David Nordstrom, Yushan Zhang, Georg Bokman, Jonathan Astermark, Viktor Larsson, Anders Heyden, Fredrik Kahl, Marten Wadenback, Michael Felsberg
方向:特征匹配 / 对应关系
数据集:MegaDepth-1500 / ScanNet-1500 / TA-WB / ScanNet++ v2 / FlyingThings3D / AerialMegaDepth / MapFree / WxBS / SatAst / HyperSim
指标:AUC@5/10/20 / EPE / PCK@1/3/5px / mAA@10px / AUC@10px / throughput / memory
单位:Linkoping University / Chalmers University of Technology / University of Amsterdam / Centre for Mathematical Sciences, Lund University
Scaling 3D Compositional Models for Robust Classification and Pose Estimation
通过类内/类间分解和动态难负样本聚焦,将 Neural Mesh Model 的组合式顶点特征扩展到 188 类,并检验分类与 pose 在遮挡、天气、合成和未知类别 OOD 条件下的稳健性。
Xiaoding Yuan, Guofeng Zhang, Prakhar Kaushik, Artur Jesslen, Adam Kortylewski, Alan Yuille
方向:物体位姿估计
数据集:ImageNet3D+ / OOD-CV
指标:classification accuracy / pose estimation accuracy / training time / OOD robustness
单位:Johns Hopkins University / University of Freiburg / Max Planck Institute for Informatics
SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow
SCFlow2 将 RGB-D 中的 3D scene flow 写成 recurrent matching 的形状约束,使 pose refiner 可作为后处理直接改善不同初始估计器且不需为新物体再训练。
Qingyuan Wang, Rui Song, Jiaojiao Li, Kerui Cheng, David Ferstl, Yinlin Hu
方向:物体位姿估计
数据集:BOP LM / YCB-Video / Objaverse / Google Scanned Objects / ShapeNet
指标:BOP AR / ADD(-S) / ADD-S AUC / refinement gain
单位:Xidian University / Taiyuan University of Technology / Magic Leap
SDFit: 3D Object Pose and Shape by Fitting a Morphable SDF to a Single Image
从单张图像检索并拟合可变形 SDF,在 render-and-compare 回路中联合优化形状和 pose;以 foundation feature 建立 2D–3D 初始化,强调遮挡、非常见姿态和 in-the-wild 图像的免重训泛化。
Dimitrije Antić, Georgios Paschalidis, Shashank Tripathi, Theo Gevers, Sai Kumar Dwivedi, Dimitrios Tzionas
方向:物体位姿估计
数据集:Pix3D / Pascal3D+ / COMIC
指标:3D Chamfer distance / 2D IoU / pose error / shape reconstruction metrics
单位:University of Amsterdam / Max Planck Institute for Intelligent Systems
Semantic Cross-Pose Correspondence from a Single Example
Semantic Cross-Pose 自动定位示范中的 interaction regions,用 DINO-ViT 语义与局部几何学习对象间 soft correspondence,再通过 differentiable SVD 把瓶颈相对位姿迁移到未见对象对。
Denis Hadjivelichkov, Sicelukwanda Zwane, Marc Peter Deisenroth, Lourdes Agapito, Dimitrios Kanoulas
方向:机器人感知与操作
数据集:GSOD / PyBullet interaction pairs / Real RGB-D interaction demonstrations / Human preference survey
指标:task success rate / survey score / cross-pose consistency
单位:University College London / Archimedes / Athena Research Center
SMORE: Simultaneous Map and Object REconstruction
SMORE 将城市 LiDAR 动态场景分解为背景与刚体对象,在 neural surfaces、ego poses 和 object poses 上交替优化,并扩展 continuous-time deskewing 来校正动态对象的 rolling-shutter LiDAR 形变。
Nathaniel Chodosh, Anish Madan, Simon Lucey, Deva Ramanan
方向:物体位姿估计
数据集:nuScenes / Argoverse 2
指标:Average Translation Error / nearest-neighbor distance / Chamfer Distance / median depth error / PSNR / SSIM / LPIPS
单位:Villanova University / Carnegie Mellon University / University of Adelaide
Rethinking Correspondence-based Category-Level Object Pose Estimation
SpotPose 把类别级 correspondence pipeline 的关键瓶颈拆为 shape-sensitive / pose-invariant feature 和 outlier removal,并在拟合前显式净化错误对应。
Huan Ren, Wenfei Yang, Shifeng Zhang, Tianzhu Zhang
方向:物体位姿估计
数据集:NOCS-REAL275 / CAMERA25 / HouseCat6D
指标:N IoU / 5° 5cm / 10° 5cm / 3D IoU
单位:University of Science and Technology of China / National Key Laboratory of Deep Space Exploration / Sangfor Technologies
Differentiable Rendering-based Pose Estimation for Surgical Robotic Instruments
该方法从单幅内窥镜 RGB、SAM2 mask、dVRK CAD / 运动学和不准确关节角出发,在四维 LookAt 候选空间中批量优化 500 个初值,再联合细化 camera-to-robot 外参与三个末端关节。真实 30 帧结果改善 RCM 几何一致性,但没有绝对外参真值或 runtime;它是 markerless tracker 初始化,不是实时 tracking。
Zekai Liang, Zih-Yun Chiu, Florian Richter, Michael C. Yip
方向:物体位姿估计
数据集:custom real dVRK calibration frames / custom gauze and suture-needle picking trials
指标:RCM converging-point distance standard deviation / open-loop picking success rate
单位:University of California San Diego (UCSD)
SurgiPose: Estimating Surgical Tool Kinematics from Monocular Video for Surgical Robot Learning
SurgiPose 在首帧从 3×3 mask-center 网格和 36 个视轴角度构造 324 个候选,再以关节条件 3D Gaussian Splatting 联合细化工具 6D pose 与三个关节角,后续帧 warm-start 优化。两任务 ADE 为 9.7 / 12.0 mm;估计轨迹监督的 ACT 策略成功率为 70% / 60%,低于真值监督的 100% / 80%,且速度和跨数据集定量泛化尚未报告。
Juo-Tung Chen, XinHao Chen, Ji Woong Kim, Paul Maria Scheikl, Richard Jaepyeong Cha, Axel Krieger
方向:物体位姿估计
数据集:custom dVRK Si tissue-lifting demonstrations / custom dVRK Si needle-pickup demonstrations / SurgRIPE / custom ex vivo cholecystectomy dataset
指标:Average Displacement Error / Final Displacement Error / per-axis trajectory error / policy task success rate / policy execution time
单位:Johns Hopkins University / Optosurgical
UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References
UA-Pose 以带 uncertainty 的混合对象模型区分已观测与未观测区域,让不完整 reference 同时支持 pose confidence、鲁棒估计和在线形状补全。
Ming-Feng Li, Xin Yang, Fu-En Wang, Hritam Basak, Yuyin Sun, Shreekant Gayaka, Min Sun, Cheng-Hao Kuo
方向:物体位姿估计
数据集:YCB-Video / YCBInEOAT / HO3D
指标:ADD-S AUC / ADD AUC / AR / object completion
单位:Carnegie Mellon University / Stony Brook University / National Tsing Hua University / Amazon
Ultra-Precision 6DoF Pose Estimation Using 2-D Interpolated Discrete Fourier Transform
用 2D interpolated DFT 从周期图案的相位和频率估计 6DoF pose,并建立图像参数到 pose 的数学映射,面向纳米级平移与微弧度级旋转的受控工业测量。
Guowei Shi, Zian Mao, Peisen Huang
方向:物体位姿估计
数据集:periodic-pattern simulation / industrial camera measurement setup
指标:translation RMSE / rotation RMSE / nanometer accuracy / microradian accuracy
单位:UM-SJTU Joint Institute, Shanghai Jiao Tong University
Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation
该方法以 4–6 个独立 teacher 的二维关键点方差估计 epistemic uncertainty,在 unbalanced OT 中降低不稳定 teacher 点的蒸馏质量;PFKD 再复用同一 transport plan 对齐对应关键点的 feature receptive fields,把 WDRNet / SPNv2 压缩到 2.3–3.8M 参数并改善 LINEMOD 与 SPEED+ pose。
Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada
方向:物体位姿估计
数据集:LINEMOD / SPEED+
指标:ADD(-S)-0.1d / rotation error / translation error / pose error / parameters / FLOPs
单位:University of Luxembourg / ENSI / University of Manouba / Infinite Orbits
Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes
利用带学习顶点特征的 neural mesh 作为类别 3D prototype,在 RGB 单阶段框架中共同完成 detection、6D pose 和 9D pose refinement,避免 detector 与单物体 pose 网络串联。
Tom Fischer, Xiaojie Zhang, Eddy Ilg
方向:物体位姿估计
数据集:REAL275 / CAMERA25
指标:3D IoU / rotation error / translation error / scale error / mAP
单位:Saarland University / University of Technology Nuremberg
Universal Features Guided Zero-Shot Category-Level Object Pose Estimation
Universal Features Pose 以 2D 通用特征获得稀疏语义对应和粗 pose,再以 3D 通用特征做稠密对齐、形状优化与 pose refinement,实现无需额外微调的零样本类别级估计。
Wentian Qu, Chenyu Meng, Heng Li, Jian Cheng, Cuixia Ma, Hongan Wang, Xiao Zhou, Xiaoming Deng, Ping Tan
方向:物体位姿估计
数据集:NOCS-REAL275 / Wild6D
指标:3D IoU / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:Institute of Software, Chinese Academy of Sciences / University of Chinese Academy of Sciences / The Hong Kong University of Science and Technology / Aerospace Information Research Institute, Chinese Academy of Sciences
UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image
UNOPose 将 reference acquisition 降到一张未设姿 RGB-D 图像:用 SE(3)-invariant reference frame 规范化对象,并按 overlap likelihood 重新加权对应关系。
Xingyu Liu, Gu Wang, Ruida Zhang, Chenyangguang Zhang, Federico Tombari, Xiangyang Ji
方向:物体位姿估计
数据集:UNOPose benchmark / BOP: LM-O / TUD-L / YCB-V
指标:BOP AR / segmentation mAP / runtime
单位:Tsinghua University / Technical University of Munich / Google
VAPO: Visibility-Aware Keypoint Localization for Efficient 6DoF Object Pose Estimation
VAPO 将关键点可见性拆为由 mask 决定的外部遮挡与由表面法向近似的内部自遮挡,并在对象 k-NN 图上以 Personalized PageRank 将二值标签扩散为连续重要度;网络只定位当前图像排名前 256 / 512 的关键点,再经 Progressive-X / PnP 恢复 pose,并可用多视角重建网格替代精确 CAD。
Ruyi Lian, Yuewei Lin, Longin Jan Latecki, Haibin Ling
方向:物体位姿估计
数据集:LINEMOD / LINEMOD-Occlusion / YCB-Video
指标:ADD(-S) recall at 0.02d / 0.05d / 0.1d / AUC of ADD-S / AUC of ADD(-S) / runtime
单位:South Dakota State University / Brookhaven National Laboratory / Temple University / Stony Brook University
Free-Moving Object Reconstruction and Pose Estimation with Virtual Camera
Virtual Camera Pose 在单目自由运动序列中联合重建形状与连续 pose:先在虚拟相机坐标系缩小优化空间,再通过 PnP 回到真实相机并做全局 refinement。
Haixin Shi, Yinlin Hu, Daniel Koguciuk, Juan-Ting Lin, Mathieu Salzmann, David Ferstl
方向:物体位姿估计
数据集:HO3D / egocentric free-moving object sequences
指标:HDRM SE / AUC ATE / relative rotation error / relative translation error
单位:École polytechnique fédérale de Lausanne / Magic Leap
ViTa-Zero: Zero-Shot Visuotactile Object 6D Pose Estimation
ViTa-Zero 先检查视觉 pose 是否满足接触、穿透和运动学约束;若不可行,则把手—物交互建模为 spring–mass system,在测试时优化 FoundationPose / MegaPose 的结果。
Hongyu Li, James Akl, Srinath Sridhar, Tye Brady, Taskin Padir
方向:物体位姿估计
数据集:Five-object real visuotactile manipulation set
指标:ADD-S AUC / ADD AUC / position error / runtime
单位:Amazon Fulfillment Technologies & Robotics / Brown University / Northeastern University
You Only Estimate Once: Unified, One-Stage, Real-Time Category-Level Articulated Object 6D Pose Estimation for Robotic Grasping
YOEO 用单个 point-cloud network 并行预测 part semantic、centroid offset 与 NPCS,以投票聚类分离部件实例,再对 NPCS 与观测点云做配准,面向实时关节物体操作。
Jingshun Huang, Haitao Lin, Tianyu Wang, Yanwei Fu, Yu-Gang Jiang, Xiangyang Xue
方向:物体位姿估计
数据集:GAPartNet / Real-world Kinova manipulation set
指标:rotation error / translation error / scale error / 3D mIoU / robot success rate
单位:Fudan University / Tencent Robotics X
ZeroBP: Learning Position-Aware Correspondence for Zero-Shot 6D Pose Estimation in Bin-Picking
ZeroBP 将局部点云特征与对象中心方向编码共同写入 cross-attention,通过 superpoint-to-point 的交替 pose / position refinement,减少工业工件重复局部几何造成的错配。
Jianqiu Chen, Zikun Zhou, Xin Li, Ye Zheng, Tianpeng Bao, Zhenyu He
方向:物体位姿估计
数据集:Google Scanned Objects synthetic set / ROBI
指标:AR of ADD(-S) / ADD(-S)-0.1d
单位:Harbin Institute of Technology, Shenzhen / Pengcheng Laboratory / JD.com / SenseTime Research
ZeroPose: CAD-Prompted Zero-Shot Object 6D Pose Estimation in Cluttered Scenes
面向训练未见刚性实例的 CAD-based RGB-D 6D pose:先将每个目标 CAD 离线渲染为多视角 RGB-D,并缓存 DINOv2 图像/patch 特征与几何特征;推理时以 FastSAM 提议和全局视觉匹配发现所有目标实例,以局部 patch 匹配预测可见视角,再对可见 CAD 表面与场景点云做粗到细 3D-3D 匹配和加权 SVD。它无需为新物体重训,也无需人工给 mask,但仍依赖带尺度 CAD、深度、内参与一次性 onboarding。
Jianqiu Chen, Zikun Zhou, Mingshan Sun, Rui Zhao, Liwei Wu, Tianpeng Bao, Zhenyu He
方向:物体位姿估计
数据集:Google Scanned Objects / BOP core datasets / LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HomebrewedDB / YCB-Video
指标:instance segmentation mAP / BOP AR (VSD/MSSD/MSPD) / ADD-S 2 cm / inference time / onboarding time
单位:Harbin Institute of Technology, Shenzhen / Pengcheng Laboratory / SenseTime Research
6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation
6D-Diff 将 2D keypoint 定位写成由热图分布到确定坐标的条件反向扩散,并用 9 分量 Mixture-of-Cauchy 拟合遮挡与杂乱造成的重尾、多峰误差。LM-O 平均 ADD(-S) 为 79.6,YCB-V 的 ADD(-S) / ADD-S AUC / ADD(-S) AUC 为 83.8 / 91.5 / 87.0;不用 MoC 时 LM-O 降至 73.1。
Li Xu, Haoxuan Qu, Yujun Cai, Jun Liu
方向:物体位姿估计
数据集:LM-O / YCB-Video
指标:ADD(-S) / AUC of ADD-S / AUC of ADD(-S)
单位:Singapore University of Technology and Design / Nanyang Technological University
Shape From Shading for Robotic Manipulation
该系统以两台相机、六个低入射角方向光和一个顶光采集七张静态 RGB,用 calibrated photometric stereo 恢复 matte-white Lambertian 小物体的 normals、depth edges 与可选表面。十个打印物体的 mean surface error 为 0.50–1.74 mm;known-object CAD alignment 的定量指标是 0.80–5.50 px 边缘错位,并非 GT R/t;unknown-object 表只验证相对平面 x/y/theta,误差最高 3.28 mm、2.40 mm、1.28°。它展示主动光照对抓取与 pose 的价值,但不是自然材质、单帧或标准 full-6D benchmark 方法。
Arkadeep Narayan Chaudhury, Leonid Keselman, Christopher G. Atkeson
方向:机器人感知与操作
数据集:custom controlled-illumination tabletop objects / custom robot suction-grasp trials / custom PVC-card deformation experiment / custom known-object pose and unknown-object tracking tests / DiLiGenT
指标:surface-normal angular error / integrated-surface error in millimeters / image-edge pixel misalignment / planar translation error / planar rotation error / normal-distribution dissimilarity / grasp trial outcomes / deformation fit R-squared
单位:Carnegie Mellon University
Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation
面向类别级 6D pose,在 RGB-D 输入上学习 instance-adaptive sparse keypoints,并用 local/global geometric-aware feature aggregation 建立关键点级 NOCS 对应;不依赖类别 shape prior,在 REAL275 和 CAMERA25 上提升未见实例泛化。
Xiao Lin, Wenfei Yang, Yuan Gao, Tianzhu Zhang
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / NOCS
指标:3D IoU / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:University of Science and Technology of China / Jianghuai Advance Technology Center
Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Images
Cas6D 以自监督 ViT 稳定少样本目标检测,保留 top-K 参考 pose 假设,并用多尺度 warped feature volume 与逐级收窄的离散 pose bins 修正大初值误差。
Panwang Pan, Zhiwen Fan, Brandon Yushan Feng, Peihao Wang, Chenxin Li, Zhangyang Wang
方向:物体位姿估计
数据集:LINEMOD / GenMOP
指标:ADD(S)-0.1d / Proj-5 / mAP@[.5:.95]
单位:ByteDance / The University of Texas at Austin / University of Maryland / The Hong Kong Polytechnic University
Category-level Object Detection, Pose Estimation and Reconstruction from Stereo Images
CODERS 把沿双目 frusta 采样的 metric 3D coordinates 编码进 ConvNeXt features,以 DETR queries 同时输出多对象 detection、6D pose、size 与 DeepSDF mesh。TOD bottle/mug 的 3D50 为 99.5/100,但严格 bottle 3D75 为 31.5;SS3D 覆盖 16 类 427 实例,当前代码/数据已公开,固定相机设定下 RTX3090 仅 3Hz。
Chuanrui Zhang, Yonggen Ling, Minglei Lu, Minghan Qin, Haoqian Wang
方向:物体位姿估计
数据集:SS3D / TOD / OmniObject3D
指标:3D IoU precision at 25% / 50% / 75% / 5°2cm / 5°5cm / 10°5cm / 10°10cm / Chamfer distance / inference FPS
单位:Tsinghua University / Tencent Robotics X
ContactArt: Learning 3D Interaction Priors for Category-level Articulated Object and Hand Poses Estimation
ContactArt 从人类 teleoperation 仿真数据学习部件排列 discriminator 和接触 diffusion prior,并以二者约束真实图像中的类别级 articulated object 与 hand pose。
Zehao Zhu, Jiashun Wang, Yuzhe Qin, Deqing Sun, Varun Jampani, Xiaolong Wang
方向:物体位姿估计
数据集:ContactArt / HOI4D / BMVC articulated-object dataset / RBO
指标:5°5cm / mIoU / rotation error / translation error / hand MPJPE
单位:The University of Texas at Austin / Carnegie Mellon University / UC San Diego / Google Research
Object Pose Estimation via the Aggregation of Diffusion Features
该方法冻结 Stable Diffusion v1.5,聚合 U-Net 多层中间特征做模板匹配;CWA 在 unseen LM / O-LM 达 98.2 / 85.9 Acc15,T-LESS 以 21k 模板达 71.03 VSD recall。优势是未见对象表征泛化,代价是仍需 CAD、真值 crop 与大模板库,并不直接回归完整 6D pose。
Tianfu Wang, Guosheng Hu, Hongguang Wang
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD / T-LESS
指标:Acc15 rotation-and-class accuracy / Recall VSD at 0.3 / trainable parameter count
单位:Shenyang Institute of Automation, Chinese Academy of Sciences / Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences / University of Chinese Academy of Sciences / Oosto
DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-Level Pose Estimation
DiffusionNOCS 用条件扩散生成多个稠密 NOCS 图,并以深度—NOCS 3D 对应和 TEASER++ 恢复尺度与 6D pose;多模态条件和多噪声假设同时面向对称多解、深度缺失与纯合成训练的跨真实环境泛化。
Takuya Ikeda, Sergey Zakharov, Tianyi Ko, Muhammad Zubair Irshad, Robert Lee, Katherine Liu, Rares Ambrus, Koichi Nishiwaki
方向:物体位姿估计
数据集:NOCS REAL275 / TYO-L / YCB-V / HOPE / ShapeNet synthetic training set
指标:5°5cm mAP / 10°5cm mAP / 15°5cm mAP / inference time
单位:Woven by Toyota / Toyota Research Institute
Neural Implicit Representation for Building Digital Twins of Unknown Articulated Objects
DigitalTwinArt 先分别重建两个 articulation state 的对象级 neural SDF,再以 part segmentation、共享刚体 motion 与显式 correspondence field 联合恢复多关节数字孪生。多部件消融中完整模型的 axis angle / mixed-unit part motion / moving-part CD 为 0.26° / 0.09 / 0.33 mm;去共享 motion 后分别恶化到 14.42° / 0.28 / 127.08 mm。
Yijia Weng, Bowen Wen, Jonathan Tremblay, Valts Blukis, Dieter Fox, Leonidas Guibas, Stan Birchfield
方向:物体位姿估计
数据集:PARIS Two-Part Object Dataset / Synthetic Multi-Part Object Dataset
指标:joint axis angle / position error / part motion error / Chamfer Distance for static / moving / whole shape
单位:NVIDIA / Stanford University
RGB-Based Category-Level Object Pose Estimation via Decoupled Metric Scale Recovery
DMSR 将 RGB-only 类别级 pose 的 correspondence learning 与 metric-scale recovery 解耦:单目深度 / 法向提供局部几何,独立尺度分支避免尺度误差污染 PnP,最终同时恢复类内未见实例的 pose 与尺寸。
Jiaxin Wei, Xibin Song, Weizhe Liu, Laurent Kneip, Hongdong Li, Pan Ji
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / NOCS
指标:3D IoU / 5° 2cm / 5° 5cm / 10° 2cm / 10° 5cm
单位:ShanghaiTech University / Tencent / Australian National University
DVMNet: Computing Relative Pose for Unseen Objects Beyond Hypotheses
DVMNet 用 cross-view attention 将两幅 RGB 特征提升为对象中心 3D voxels,以 soft voxel matching 和 Weighted Closest Voxel 加权 SVD 直接求相对旋转,不枚举姿态。CO3D 未见 10 类 mean angular error 19.95°,GROP Objaverse / LINEMOD 为 20.19° / 36.82°,A100 上每对图约 23 ms。
Chen Zhao, Tong Zhang, Zheng Dang, Mathieu Salzmann
方向:物体位姿估计
数据集:CO3D / GROP-LINEMOD / GROP-Objaverse
指标:mean angular error / multiply-accumulate operations / pair latency
单位:EPFL / ClearSpace SA
Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
Dynamic 3D Gaussians 固定 Gaussian 外观与身份,只让位置和 orientation 随时间变化,并以局部刚性/等距正则从动态多视图渲染中得到稠密 6DoF trajectories。
Jonathon Luiten, Georgios Kopanas, Bastian Leibe, Deva Ramanan
方向:3D 表示 / 重建
数据集:PanopticSports / Particle-NeRF
指标:PSNR / SSIM / LPIPS / 2D / 3D median trajectory error / tracking accuracy / survival rate
单位:Carnegie Mellon University / RWTH Aachen University / Inria & Université Côte d’Azur
EDOPT: Event-Camera 6-DoF Dynamic Object Pose Tracking
EDOPT 以 EROS 增量事件面作为观测、以已知 mesh 的 13 个局部位姿假设作为期望,通过两个异步线程实现 event-only 6DoF 跟踪。论文报告离线平均误差 0.70 cm / 2.30°,在线更新率超过 300 Hz;方法无需对象训练,但依赖外部初始化、已知模型和持续可见的事件边缘。
Arren J. Glover, Luna Gava, Zhichao Li, Chiara Bartolozzi
方向:物体位姿估计
数据集:EDOPT synthetic dragon comparison / EDOPT five-object event pose dataset / live ATIS toy-car trial
指标:mean position error / mean rotation error / online update rate / tracking error over six independent-axis motions
单位:Istituto Italiano di Tecnologia
Direct 3D Model-Based Object Tracking with Event Camera by Motion Interpolation
BIAM 将 ROI 内事件转成绝对 brightness increments,并在 3D model rendering 中插值整个运动窗口,使预测图具有与真实事件相似的累积模糊;它在透视 / 鱼眼相机和最高约 2 m/s 运动下改善持续跟踪。
Yufan Kang, Guillaume Caron, Ryoichi Ishikawa, Adrien Escande, Kevin Chappellet, Ryusuke Sagawa, Takeshi Oishi
方向:物体位姿估计
数据集:BIAM event object-tracking dataset / YCB objects
指标:RMS position error / RMS rotation error / tracking duration
单位:CNRS-AIST Joint Robotics Laboratory / The University of Tokyo / Inria
Real-Time 6-DoF Pose Estimation by an Event-Based Camera Using Active LED Markers
该系统用每颗 LED 的唯一闪烁频率建立事件像素到已知 marker 几何的身份对应:短窗口累积负责检测与频率识别,独立 LED trackers 逐事件更新亚像素中心,IPPE-PnP 异步输出 marker 相对 event camera 的 6DoF pose。桌面 tracking 平均延迟 354 μs、输出 3.81 kHz;2.1–4.8 m 静态实验平均误差 34.5 mm / 0.738°,并展示约 10 m/s 无人机飞行。性能依赖主动硬件、bias 调节、完整 LED 可见性和平面 PnP 几何,室外高速实验也未证明仍保持静态精度。
Gerald Ebmer, Adam Loch, Minh Nhat Vu, Roberto Mecca, Germain Haessig, Christian Hartl-Nesic, Markus Vincze, Andreas Kugi
方向:物体位姿估计
数据集:custom OptiTrack active-marker accuracy test / custom indoor and outdoor quadcopter flights
指标:translation error / rotation error / normalized position error / tracking latency / pose output rate / static pose noise
单位:TU Wien / Austrian Institute of Technology / Prophesee
FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation
FAFA 先以 real-amplitude mix / dropout 增强 PBR synthetic RGB,再用 EMA teacher 的 pseudo-flow / pseudo-pose,以及 photometric、warped-mask、feature 和 point-matching consistency 自监督 refinement。ROV6D / DeepURL mean 为 91.39 / 73.46;仍依赖已知 UUV CAD、coarse pose 与每域 1,000 张 real images,仓库当前没有实现代码。
Jingyi Tang, Gu Wang, Zeyu Chen, Shengquan Li, Xiu Li, Xiangyang Ji
方向:物体位姿估计
数据集:ROV6D / DeepURL
指标:ADD at 0.05d / 0.1d / ADD-S at 0.05d / 0.1d / 5° accuracy / 5cm accuracy / mean threshold accuracy
单位:Tsinghua University / Peng Cheng Laboratory
Implicit Coarse-to-Fine 3D Perception for Category-Level Object Pose Estimation from Monocular RGB Image
FAP-Net 以 geometry supervision 形成粗粒度三维感知,再用 pose 与 size constraints 细化特征;公开摘要在 REAL275 上报告 10°10cm 与 IoU50 分别提升 14.7、11.4 个百分点,并达到 42 FPS。
Jia Li, Li Jin, Xibin Song, Yeheng Chen, Nan Li, Xueying Qin
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / NOCS
指标:3D IoU50 / 10° 10cm / runtime
单位:Samsung
FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videos
FastCAD 将对象检测、upright 9DoF alignment 与 CAD embedding regression 合入一次 scene-level forward,并通过训练期 embedding distillation 移除测试时的逐对象 encoder。Scan 输入为 61.7% / 50ms,视频管线为 48.2% / 100ms;29.6 reconstruction accuracy 仅对应受限为 Vid2CAD 相同检索池的设置。
Florian Langer, Jihong Ju, Georgi Dikov, Gerhard Reitmayr, Mohsen Ghafoorian
方向:物体位姿估计
数据集:ScanNet / Scan2CAD / ShapeNet
指标:Scan2CAD instance alignment accuracy / class alignment accuracy / reconstruction accuracy / shape accuracy / translation error threshold / rotation error threshold / scale error threshold / inference time
单位:XR Labs, Qualcomm Technologies / University of Cambridge
Fit-NGP: Fitting Object Models to Neural Graphics Primitives
Fit-NGP 让腕载 RGB 相机扫描静态场景并训练 Instant-NGP,再把已知 CAD 表面直接拟合到 density field;相机位姿联合优化和法向邻域采样是达到 1.6 mm / 3.3° 中位误差的关键。
Marwan Taher, Ignacio Alzugaray, Andrew J. Davison
方向:物体位姿估计
数据集:Four real tabletop scenes with 43 object instances
指标:median translation error / median rotation error
单位:Dyson Robotics Lab, Imperial College London
Few-View Object Reconstruction with Unknown Categories and Camera Poses
FORGE 让三维 voxel features 同时承担跨视图 pose correlation 与 neural volume reconstruction,并通过渲染损失在测试时进一步联合校正少视图相机 pose。
Hanwen Jiang, Zhenyu Jiang, Kristen Grauman, Yuke Zhu
方向:3D 表示 / 重建
数据集:Kubric / OmniObject3D / Google Scanned Objects
指标:PSNR / SSIM / LPIPS / relative rotation error / relative translation error
单位:The University of Texas at Austin
FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
面向训练未见刚性实例的统一 RGB-D 6D pose 与 tracking:CAD 已知时直接渲染,CAD 缺失时由少量带位姿参考图拟合 object-centric neural field 以渲染 RGB-D;全局采样假设经 Transformer RefineNet 细化,再由跨假设 self-attention ScoreNet 排序。LLM 和扩散模型只用于扩充合成训练数据,测试时不输入文本也不微调主网络。
Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield
方向:物体位姿估计
数据集:LINEMOD / Occluded-LINEMOD / YCB-Video / T-LESS / YCBInEOAT
指标:ADD AUC / ADD-S AUC / ADD-0.1d / BOP AR (VSD/MSSD/MSPD) / tracking speed
单位:NVIDIA
FoundPose: Unseen Object Pose Estimation with Foundation Features
FoundPose 在每对象少于 5 分钟的 onboarding 中把 800 个 CAD templates 的 DINOv2 layer-18 patch features 注册到 3D,在线用 BoW 检索 5 个视角、2D–3D matching 与 PnP-RANSAC 得到 pose。Training-free coarse / featuremetric AR 为 37.2 / 42.6;59.6 AR 的最高配置另接了在 200 万余合成图上训练的 MegaPose refiner。
Evin Pınar Örnek, Yann Labbé, Bugra Tekin, Lingni Ma, Cem Keskin, Christian Forster, Tomas Hodan
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HB / YCB-Video
指标:BOP Average Recall / VSD / MSSD / MSPD / seconds per image / object onboarding time / per-object representation memory
单位:Technical University of Munich / Meta Reality Labs
FreeZe: Training-free Zero-shot 6D Pose Estimation with Geometric and Vision Foundation Models
FreeZe 将 CAD 与 RGB-D target 的多尺度 GeDi geometry 和提升到 3D 的 DINOv2 features 各自归一化后拼接,以 feature NN、RANSAC、ICP 和 visual symmetry selection 求 pose。CNOS masks 下 coarse / refined BOP AR 为 64.0 / 69.3;SAR 仅在 ICP 上平均增加 0.5,且论文未报告端到端 runtime。
Andrea Caraffa, Davide Boscaini, Amir Hamza, Fabio Poiesi
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HB / YCB-Video
指标:BOP Average Recall / VSD / MSSD / MSPD
单位:Fondazione Bruno Kessler / University of Trento
GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects
GenFlow 在观测图与当前 CAD render 之间循环估计 flow、certainty、pose sensitivity 和 6D pose,并以 3D shape-constrained correlation lookup 与 differentiable PnP 保持投影几何。CNOS 未见对象协议下 RGB / RGB-D mean AR 为 57.8 / 67.2;完整设计消融为 70.7,比无 shape constraint 高 4.4。
Sungphill Moon, Hyeontae Son, Dongcheol Hur, Sangwook Kim
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HomebrewedDB / YCB-Video / MegaPose synthetic training set
指标:BOP Average Recall / VSD / MSSD / MSPD / render count / refinement latency
单位:NAVER LABS
GeoReF: Geometric Alignment Across Shape Variation for Category-level Object Pose Refinement
GeoReF 用 HS-layer 与三组可学习仿射变换对齐观测实例和类别 shape prior,再以 Cross-Cloud Transformation 混合两云特征并回归旋转、平移和尺寸残差。以 SPD 初始化时 REAL275 达 IoU75 51.8、5°2cm 54.4;仅用 CAMERA25 的 2% 训练图仍达 IoU75 77.5。
Linfang Zheng, Tze Ho Elden Tse, Chen Wang, Yinghan Sun, Hua Chen, Aleš Leonardis, Wei Zhang, Hyung Jin Chang
方向:物体位姿估计
数据集:NOCS-REAL275 / NOCS-CAMERA25
指标:3D IoU50 / IoU75 mAP / 5°2cm / 5°5cm / 10°2cm / 10°5cm / 2cm / 5°
单位:Southern University of Science and Technology / The University of Hong Kong / University of Birmingham
GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence
GigaPose 只渲染 162 个 out-of-plane 模板,再由单个 2D–2D patch correspondence 预测尺度、面内旋转和平移并以 RANSAC 选 pose。七个 BOP 数据集 coarse mean AR 26.8、0.4 s/图;单检测 coarse 48 ms,比 MegaPose 1.68 s 快约 35×,接五假设 GenFlow 后 mean AR 60.5。
Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, Vincent Lepetit
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HomebrewedDB / YCB-Video / BOP synthetic training set
指标:BOP Average Recall / VSD / MSSD / MSPD / onboarding time / coarse pose latency
单位:LIGM, École des Ponts / Adobe / EPFL
GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence
GS-Pose 将多视角 DINOv2 features 回投到 CAD points,与 normalized geometry 一起学习 synthetic full-to-partial 3D correspondences,再用 RANSAC + Umeyama 求未见真实实例的 pose / scale。每类 10 CAD 时 REAL275 为 63.2 3D*50 / 28.8 5°5cm;优势是数据效率,不是全面超过强 real-supervised 模型。
Pengyuan Wang, Takuya Ikeda, Robert Lee, Koichi Nishiwaki
方向:物体位姿估计
数据集:ShapeNet / NOCS-REAL275 / Wild6D / SUN RGB-D
指标:3D IoU precision / 5°5cm / 10°5cm / 15°5cm / 20°10cm / 40°20cm / 60°30cm / inference time
单位:Technical University of Munich / Woven by Toyota
HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation
HiPose 预测每个 RGB-D 点的层级二进制表面码,从粗 point-to-surface 对应出发逐 bit 缩小表面,同时按当前 pose 剔除离群点,最后用 Kabsch 求 pose。LM-O ADD(-S) recall 为 89.6,BOP 三数据集 mean score 84.6;pose 0.075 s、含检测 0.16 s,不依赖渲染式 refinement。
Yongliang Lin, Yongzhi Su, Praveen Nathan, Sandeep Inuganti, Yan Di, Martin Sundermeyer, Fabian Manhardt, Didier Stricker, Jason Rambach, Yu Zhang
方向:物体位姿估计
数据集:LM-O / YCB-Video / T-LESS / BOP PBR
指标:ADD(-S) recall / AUC of ADD-S / AUC of ADD(-S) / BOP score / runtime
单位:Zhejiang University / German Research Center for Artificial Intelligence (DFKI) / RPTU Kaiserslautern-Landau / Technical University of Munich / Google
HOC-Search: Efficient CAD Model and Pose Retrieval from RGB-D Scans
HOC-Search 将类别、CAD 与 9DoF pose 组织为层次搜索树,以 MCTS 近似昂贵的穷举 render-and-compare,并只对高价值候选联合做 pose refinement。
Stefan Ainetter, Sinisa Stekovic, Friedrich Fraundorfer, Vincent Lepetit
方向:物体位姿估计
数据集:ScanNet / Scan2CAD
指标:Top-1 / Top-5 CAD retrieval accuracy / Chamfer Distance / speedup factor
单位:Graz University of Technology / LIGM, École des Ponts, Université Gustave Eiffel, CNRS
HouseCat6D - A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarios
HouseCat6D 发布 194 个对象、10 类、41 个真实场景、23.5k 帧和约 160k pose,另有约 10M 抓取标注;外部红外跟踪、标定与 bundle adjustment 将点级标注误差控制在 1.35–1.73 mm。VI-Net 的总体 3D25/50 为 80.7/56.4,透明玻璃强而 box/remote 仍难。
HyunJun Jung, Shun-Cheng Wu, Patrick Ruhkamp, Guangyao Zhai, Hannah Schieber, Giulia Rizzoli, Pengyuan Wang, Hongcheng Zhao, Lorenzo Garattoni, Sven Meier, Daniel Roth, Nassir Navab, Benjamin Busam
方向:物体位姿估计
数据集:HouseCat6D
指标:3D IoU at 25% / 50% / point-wise annotation RMSE / grasp coverage rate / object success rate / real-world grasp success rate
单位:Technical University of Munich / Munich Center for Machine Learning / FAU Erlangen-Nürnberg / University of Padova / Toyota Motor Europe / 3dwe.ai
IFFNeRF: Initialisation Free and Fast 6DoF Pose Estimation from a Single Image and a NeRF Model
IFFNeRF 从 NeRF density field 采样表面并生成参数化 rays,以 DINOv2 image features 和 attention 检索指向真实相机中心的 rays,再通过加权线性 least squares 无初值恢复 pose,推理约 29 ms。
Matteo Bortolon, Theodore Tsesmelis, Stuart James, Fabio Poiesi, Alessio Del Bue
方向:物体位姿估计
数据集:NeRF Synthetic / Tanks and Temples
指标:mean angular error / mean translation error / runtime / memory
单位:Istituto Italiano di Tecnologia / Fondazione Bruno Kessler / University of Trento / Durham University
Towards Co-Evaluation of Cameras, HDR, and Algorithms for Industrial-Grade 6DoF Pose Estimation
IPD 发布 20 个工业零件、2,300 个物理场景、13 台相机与超过 10 万对象视图,并用 Robot Consistency 在不依赖毫米级人工真值的情况下评估 MVD。合成验证中其误差偏差为 0.13 mm,而 1 mm 抖动标注为 0.47 mm;Basler-HR 最稳,Mertens HDR 在 spotlight 下达到 3.061 mm MVD / 0.77 recall。
Agastya Kalra, Guy Stoppi, Dmitrii Marin, Vage Taamazyan, Aarrushi Shandilya, Rishav Agarwal, Anton Boykov, Tze Hao Chong, Michael Stark
方向:物体位姿估计
数据集:Industrial Plenoptic Dataset (IPD)
指标:Maximum Vertex Distance / robot consistency error / precision / recall
单位:Intrinsic Innovation LLC
Joint-Loss Enhanced Self-Supervised Learning for Refinement-Coupled Object 6D Pose Estimation
该方法用 Iterative Annotation Resolver 从无 6D 标注 RGB-D 数据迭代构造监督,以 pixelwise weighted dense fusion 估计初始 pose,再用 differentiable renderer 与 joint loss 训练 refinement;作者摘要称精度接近监督方法,但未公开具体数据集与数值。
Fengjun Mu, Shixiang Sun, Rui Huang, Chaobin Zou, Wenjiang Li, Huayi Zhan, Hong Cheng
方向:物体位姿估计
数据集:Unannotated RGB-D object observations (dataset not disclosed in public abstract)
指标:6D pose accuracy (public abstract gives qualitative comparison only)
单位:University of Electronic Science and Technology of China / Changhong
Learning Better Keypoints for Multi-Object 6DoF Pose Estimation
KeyGNet 将 FPS / BBox 固定关键点改成离线 target-design:EdgeConv 从一个数据集的对象可见彩色表面学习共享 3D 关键点,以 Wasserstein loss 对齐不同关键点的投票分布,并用 dispersion loss 防止几何坍缩。替换 PVNet、PVN3D、RCVPose 的关键点后,七个 BOP core datasets 的 MIMO 平均 AR 分别提高 11.3、12.0、10.0 points;PVN3D 在 LMO 的 ADD(S) 从 53.9 升至 70.3。优势集中在缩小 SISO→MIMO gap,但依赖 GT pose、内参、已知几何和可见表面,并需按数据集与 voting representation 分别训练。
Yangzheng Wu, Michael Greenspan
方向:物体位姿估计
数据集:LINEMOD-Occlusion / YCB-Video / T-LESS / TUD-L / IC-BIN / ITODD / HomebrewedDB
指标:BOP Average Recall / VSD recall / MSSD recall / MSPD recall / ADD(S) / ADD(S) AUC / SISO-to-MIMO performance gap / training time
单位:Queen's University
L4D-Track: Language-to-4D Modeling Towards 6-DoF Tracking and Shape Reconstruction in 3D Point Cloud Stream
L4D-Track 联合 pairwise implicit 3D pose/shape field 与多层语言对齐,从点云流因果追踪 6DoF 并重建当前对象。NOCS-REAL275 达 IoU75 / 5°5cm 76.0 / 56.2,跨域到未微调的 YCB-Video 平均 ADD / ADD-S 为 80.4 / 86.1,NOCS / YCB 速度为 20.45 / 19.28 FPS;但追踪协议需要首帧真值 pose 与 size。
Jingtao Sun, Yaonan Wang, Mingtao Feng, Yulan Guo, Ajmal Mian, Mike Zheng Shou
方向:物体位姿估计
数据集:NOCS-REAL275 / YCB-Video
指标:3D IoU25 / IoU50 / IoU75 / 5°2cm / 5°5cm / 10°2cm / 10°5cm / rotation / translation error / ADD / ADD-S / Chamfer Distance / FPS
单位:Hunan University / National University of Singapore / Xidian University / Sun Yat-sen University / The University of Western Australia
LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation
LaPose 由 DINOv2 / ConvNet 两个分支预测 NOCS 的 Laplace mean / variance,让 learned PnP 利用局部 shape uncertainty;translation / size 按真实 3D box diagonal 归一化,绝对尺度再由 MobileNet 单独估计。REAL275 单模型为 70.7 NIoU25 / 57.4 normalized 10°0.5d,但绝对 IoU75 仅 2.6。
Ruida Zhang, Ziqin Huang, Gu Wang, Chenyangguang Zhang, Yan Di, Xingxing Zuo, Jiwen Tang, Xiangyang Ji
方向:物体位姿估计
数据集:NOCS-CAMERA25 / NOCS-REAL275
指标:Normalized 3D IoU mAP / normalized 10°0.2d / 10°0.5d / absolute 3D IoU mAP / 10°10cm / rotation threshold accuracy / normalized translation threshold accuracy
单位:Tsinghua University / Technical University of Munich / California Institute of Technology
LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals
LFM-3D 将 NOCS 或单目深度编码为关键点的 3D positional signal,注入图匹配网络以改善对象图像间宽基线对应和 relative rotation estimation。
Arjun Karpur, Guilherme Mendeleh Perrotta, Ricardo Martin-Brualla, Howard Zhou, André Araujo
方向:特征匹配 / 对应关系
数据集:Google Scanned Objects / Objectron
指标:matching precision / recall / relative rotation Acc@5° / 10° / 15°
单位:Google Research / University of Campinas
Living Scenes: Multi-object Relocalization and Reconstruction in Changing 3D Environments
MoRE² 用同一 SE(3)-equivariant encoder–DeepSDF decoder 依次完成跨扫描实例匹配、6DoF 注册和对象重建,并联合优化 pose graph 与 latent geometry。FlyingShape / 3RScan 的 MR 为 74.39 / 49.07、MRR 为 62.00 / 40.74;对 Mask3D 噪声仍有优势,但依赖实例分割且不处理非刚性与同形多实例歧义。
Liyuan Zhu, Shengyu Huang, Konrad Schindler, Iro Armeni
方向:物体位姿估计
数据集:FlyingShape / 3RScan / ShapeNet
指标:MR Recall / MRR Recall / instance matching recall / registration recall / median rotation error / RMSE / Chamfer distance / volumetric IoU / SDF recall
单位:Stanford University / ETH Zurich
LocPoseNet: Robust Location Prior for Unseen Object Pose Estimation
LocPoseNet 用双向多尺度 reference kernels 和解耦的 scale-robust / scale-aware heads,分别预测未见物体中心与尺度,为 translation 和后续 rotation refinement 提供稳健位置先验。
Chen Zhao, Yinlin Hu, Mathieu Salzmann
方向:物体位姿估计
数据集:LINEMOD / GenMOP / Synthetic LINEMOD robustness set
指标:mAP@[.5:.95] / ADD-0.1d
单位:EPFL CVLab / ClearSpace SA / Magic Leap
Effects of Markers in Training Datasets on the Accuracy of 6D Pose Estimation
论文用 paired synthetic scenes 隔离训练图像 marker shortcut,并比较固定 marker、两阶段 LaMa inpainting、全随机 marker 与固定 / 随机混合增强。Teabox markerless test 上,固定 marker 训练的 ADD-(S) 为 76.6,较 markerless baseline 84.8 低 8.2 points;inpainting 恢复到 84.8。5-object YCB-V 与 ZebraPose 复核总体支持“修复不明显伤害 pose”,但真实平均排除了严重失败的 mug / wood block,且无多 seed 区间。标签噪声 sweep 进一步显示 4 mm 以上平移或约 2.5° 旋转误差会快速侵蚀精确真值收益。
Janis Rosskamp, Rene Weller, Gabriel Zachmann
方向:物体位姿估计
数据集:synthetic teabox paired-marker dataset / real teabox marker / markerless dataset / YCB-Video five-object subset
指标:AUC of ADD-S / AUC of ADD-(S) / ADD-(S) at 10% object diameter / translation label error / rotation label error
单位:University of Bremen
MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images
MatchU 把 CAD 几何、观测深度与 RGB 纹理融合为 color-aware rotation-invariant 3D descriptors,再以匹配、RANSAC 和可选 ICP 求训练未见对象的 6D pose。单假设无 refinement 的 BOP-5 mean AR 为 50.5、0.07 s,多假设为 57.8;加入 refinement 达 64.7,说明 RGB 消歧与多假设分别改善对应质量和全局稳健性。
Junwen Huang, Hao Yu, Kuan-Ting Yu, Nassir Navab, Slobodan Ilic, Benjamin Busam
方向:物体位姿估计
数据集:Google Scanned Objects / LM-O / T-LESS / TUD-L / IC-BIN / YCB-Video
指标:BOP Average Recall / VSD / MSSD / MSPD / ADD-0.1d / runtime
单位:Technical University of Munich / Munich Center for Machine Learning / XYZ Robotics / 3dwe.ai
MFOS: Model-Free & One-Shot Object Pose Estimation
面向未见刚性实例的 CAD-free RGB one-shot 6D pose:以带位姿参考图和粗 3D cuboid 作为先验,CroCo 初始化的 ViT 将 reference image 与代理形状 pointmap 融合,预测 query 到不可见 cuboid 的稠密 2D-3D 对应及置信度,再以 RANSAC PnP 恢复姿态。
JongMin Lee, Yohann Cabon, Romain Brégier, Sungjoo Yoo, Jerome Revaud
方向:物体位姿估计
数据集:LINEMOD / OnePose / OnePose-LowTexture / Amazon Berkeley Objects (ABO)
指标:ADD(-S)-0.1d / Proj2D (5px) / 1cm-1deg / 3cm-3deg / 5cm-5deg / inference time
单位:Seoul National University / Naver Labs Europe
Learning Instance-Aware Correspondences for Robust Multi-Instance Point Cloud Registration in Cluttered Scenes
MIRETR 迭代联合学习 instance-aware superpoint feature 与实例 mask,再把粗对应展开成逐实例稠密对应和 SE(3) 候选,绕开昂贵 multi-model fitting。完整模型在 Scan2CAD / ROBI / ShapeNet 的 Mean F1 分别为 93.40 / 39.80 / 94.44;ROBI 去掉两项 instance-aware 设计后降至 18.65,改回全局 attention 仅 10.96。
Zhiyuan Yu, Zheng Qin, Lintao Zheng, Kai Xu
方向:物体位姿估计
数据集:Scan2CAD / ROBI / ShapeNet
指标:Inlier Ratio / Mean Recall / Mean Precision / Mean F1 / instance mask mIoU
单位:National University of Defense Technology / Defense Innovation Institute, Academy of Military Sciences
MOTPose: Multi-Object 6D Pose Estimation for Dynamic Video Sequences Using Attention-Based Temporal Fusion
MOTPose 在 DETR 式多对象网络内部用 TEFM 融合历史对象 embedding,并用 TOFM 融合关键点与位姿参数;相较单帧版本,它在动态 SynPick 中同时降低漏检和离群 pose,并在 YCB-Video 上保持有竞争力的精度。
Arul Selvam Periyasamy, Sven Behnke
方向:物体位姿估计
数据集:SynPick / SynPick-Ext / YCB-Video
指标:ADD AUC / ADD-S AUC / ADD(-S) AUC / cardinality error / false-negative rate
单位:University of Bonn
MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation
MRC-Net 先把旋转量化为 4,608 个原型并预测粗姿态,再渲染 CAD,以三尺度 real–render correlation 回归残差;对称感知 soft labels 缓解多解。纯 PBR 训练时四个 BOP 数据集 mean AR 为 63.3,T-LESS 消融从并行 MultiTask 的 64.9 提升到 77.1,单对象推理约 61 ms。
Yuelong Li, Yafei Mao, Raja Bala, Sunil Hadap
方向:物体位姿估计
数据集:T-LESS / ITODD / YCB-Video / LM-O
指标:BOP Average Recall / VSD / MSSD / MSPD / ADD(-S) / AUC of ADD-S / AUC of ADD(-S) / single-object latency
单位:Amazon Inc.
MV-ROPE: Multi-View Constraints for Robust Category-Level Object Pose and Size Estimation
MV-ROPE 用尺度感知 dense monocular SLAM 从视频恢复相机和 metric depth,以 NOCS—depth 配准获得关键帧对象 pose,再通过 IoU 关联和 object-level pose graph 融合多视图约束。
Jiaqi Yang, Yucong Chen, Xiangting Meng, Chenxin Yan, Min Li, Ran Cheng, Lige Liu, Tao Sun, Laurent Kneip
方向:物体位姿估计
数据集:NOCS REAL / MEREAL
指标:3D IoU mAP / 5°2cm mAP / 5°5cm mAP / mean rotation error / mean translation error
单位:ShanghaiTech University / Midea RoboZone
Perception Through Cognitive Emulation: A Second Iteration of NaivPhys4RP for Learningless and Safe Recognition and 6D-Pose Estimation of (Transparent) Objects
NaivPhys4RP 根据 context、ontology 与朴素物理生成多个可能世界,在 simulator 中预测其演化,再以贫弱观测筛选 belief particles,从而以白盒方式解释透明对象 identity 与 pose;论文是系统概念验证,不提供 BOP 定量排名。
Franklin Kenghagho Kenfack, Michael Neumann, Patrick Mania, Michael Beetz
方向:世界模型
数据集:Transparent-object cognitive emulation demonstrations
指标:qualitative recognition and 6D pose demonstration
单位:University of Bremen
NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction
NCRF 联合接触优化场、手物 canonical motion field 与 radiance field,让 contact 和多视图渲染共同修正遮挡下的 hand/object pose。
Zhongqun Zhang, Jifei Song, Eduardo Pérez-Pellitero, Yiren Zhou, Hyung Jin Chang, Aleš Leonardis
方向:3D 表示 / 重建
数据集:HO3D / DexYCB
指标:PSNR / SSIM / LPIPS / hand MPJPE / ADD-0.1D / intersection volume
单位:University of Birmingham / Huawei Noah’s Ark Lab
Marrying NeRF with Feature Matching for One-Step Pose Estimation
方法从初始 pose 渲染 NeRF RGB / depth,以 LoFTR 建立 2D–2D matches并提升为 2D–3D correspondences,再由 RANSAC-PnP 一步校正;3D consistency mining 和 keypoint-guided refinement 分别处理伪几何与遮挡。
Ronghan Chen, Yang Cong, Yu Ren
方向:物体位姿估计
数据集:NeRF Synthetic / LLFF
指标:rotation correctness / translation correctness / mean rotation error / mean translation error / FPS
单位:Shenyang Institute of Automation, Chinese Academy of Sciences / South China University of Technology
NeRF-Feat: 6D Object Pose Estimation using Feature Rendering
NeRF-Feat 用 NeRF 密度场建立无 CAD 的实例参考系,再以双向对比学习对齐 3D surface features 与 query CNN features,通过 2D–3D 对应和 PnP 恢复 pose。
Shishir Reddy Vutukur, Heike Brock, Benjamin Busam, Tolga Birdal, Andreas Hutter, Slobodan Ilic
方向:物体位姿估计
数据集:LINEMOD / LM-Occlusion / T-LESS
指标:ADD / ADD-S / BOP Average Recall
单位:Technical University of Munich / Siemens AG / Imperial College London
NeuSurfEmb: A Complete Pipeline for Dense Correspondence-Based 6D Object Pose Estimation without CAD Models
NeuSurfEmb 以 SfM、通用分割和 NeuS2 从少量真实 RGB 建立可渲染对象表面,再自动生成 cut-and-paste 训练图并训练 SurfEmb 稠密对应网络;它取消精确 CAD 与人工 PBR 管线,但仍需每对象重建和专属训练。
Francesco Milano, Jen Jen Chung, Hermann Blum, Roland Siegwart, Lionel Ott
方向:物体位姿估计
数据集:LINEMOD-Occlusion / NeuSurfEmb five-object real-world benchmark
指标:BOP Average Recall / ADD(-S) recall / 5 cm, 5° recall / forward Chamfer distance
单位:ETH Zurich / The University of Queensland
NOPE: Novel Object Pose Estimation from a Single Image
NOPE 不合成像素图,而由单张 reference 直接预测 342 个相对视角的判别 embedding,再与 query embedding 检索,得到相对旋转及其多峰歧义。ShapeNet 未见类别 top-1 Acc30 / median error 为 59.8 / 24.4°,top-5 为 87.1 / 6.6°;T-LESS 单参考 VSD recall 为 46.49,25% 遮挡下仍有 40.5 Acc30。
Van Nguyen Nguyen, Thibault Groueix, Georgy Ponimatkin, Yinlin Hu, Renaud Marlet, Mathieu Salzmann, Vincent Lepetit
方向:物体位姿估计
数据集:ShapeNet / T-LESS
指标:Acc30 / median angular error / VSD recall / occlusion robustness / memory / runtime
单位:LIGM, École des Ponts / Adobe / Magic Leap / Valeo.ai / EPFL
Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation
Omni6D 以 4,688 个真实扫描纹理网格在 Replica 场景中合成超过 80 万幅 RGB-D 观测,覆盖 166 类,并提供实例级三轴 symmetry 与未见类别测试。基线使用 GT mask;结果显示平移和尺寸可泛化,但旋转在大词汇与跨类别条件下显著失效。
Mengchen Zhang, Tong Wu, Tai Wang, Tengfei Wang, Ziwei Liu, Dahua Lin
方向:物体位姿估计
数据集:Omni6D / Omni6Dout / Omni6D-Real / REAL275 / CAMERA25
指标:3D IoU at 50% / 75% / 5°2cm / 5°5cm / 10°2cm / 10°5cm / rotation threshold accuracy / translation threshold accuracy / symmetry-aware pose error
单位:Zhejiang University / Shanghai Artificial Intelligence Laboratory / The Chinese University of Hong Kong / Nanyang Technological University
Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking
Omni6DPose 由 149 类真实 ROPE(332K 图像、1.5M+ 标注、581 实例)、合成 SOPE(475K 图像、5M+ 标注、4,162 实例)和对齐网格 PAM 组成。GenPose++ 用 DINOv2 / PointNet++ 条件扩散与聚类聚合达到 15.1 VUS@5°5cm;主表使用 GT segmentation,绝对精度仍显示大词汇 pose 很困难。
Jiyao Zhang, Weiyao Huang, Bo Peng, Mingdong Wu, Fei Hu, Zijian Chen, Bo Zhao, Hao Dong
方向:物体位姿估计
数据集:ROPE / SOPE / PAM
指标:AUC at 3D IoU thresholds / Volume Under Surface at rotation / translation thresholds / tracking mIoU / rotation error / translation error / FPS
单位:Peking University / Waseda University / Shanghai Jiao Tong University / Beijing Academy of Artificial Intelligence
OmniNOCS: A Unified NOCS Dataset and Model for 3D Lifting of 2D Objects
OmniNOCS 将 10 个来源统一为 97 类、380k 图像和 450k 余实例的 canonical NOCS 数据;NOCSformer 从外部 2D box 预测 mask、NOCS、metric size、rotation 和 centroid。它在 held-out NOCS-Real275 上以 43.5 / 10.6 的 3D IoU mAP@25 / 50 超过 transferred Cube R-CNN,但仍远低于目标域监督 NOCS 模型的 79.6 / 72.4。
Akshay Krishnan, Abhijit Kundu, Kevis-Kokitsi Maninis, James Hays, Matthew Brown
方向:物体位姿估计
数据集:OmniNOCS / KITTI / SUN RGB-D / Objectron / nuScenes / Hypersim / ARKitScenes / Cityscapes 3D / Virtual KITTI / NOCS-Real275 / Waymo Open Dataset
指标:NOCS mAE / NOCS mPSNR / mask mIoU / 3D IoU mAP / mATE / mAOE / mASE / orientation threshold accuracy
单位:Google Research / Google DeepMind / Georgia Institute of Technology
OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation
OP-Align 先以 E2PN 的 60 个 rotation anchors 将单帧 partial point cloud 整体对齐到 category-common canonical reconstruction,再依据预测的 joint direction、pivot 和 state 分别对齐部件,用距离差自监督 part segmentation。合成集达到 41 FPS 并优于 EAP,但真实集 joint strict mAP 仅 12.57,且需要已知部件数、joint 类型和训练真值辅助评测坐标系标定。
Yuchen Che, Ryo Furukawa, Asako Kanezaki
方向:物体位姿估计
数据集:EAP synthetic articulated-object dataset / OP-Align real-world articulated-object dataset / HOI4D / Shape2Motion
指标:part segmentation IoU / part rotation / translation error / joint direction / pivot error / multi-threshold mAP / FPS / GPU memory
单位:Tokyo Institute of Technology / Accenture Japan Ltd.
Open-Vocabulary Object 6D Pose Estimation
Oryon 用文本提示在 anchor / query 两幅不同场景 RGB-D 中联合定位目标、学习局部匹配并恢复相对 SE(3),不需要 CAD 或对象视频。自预测 mask 下 REAL275 / Toyota-Light BOP AR 为 32.2 / 30.3;Oracle mask 分别为 46.5 / 34.1,说明开放词汇分割仍是主要上限。
Jaime Corsetti, Davide Boscaini, Changjae Oh, Andrea Cavallaro, Fabio Poiesi
方向:物体位姿估计
数据集:ShapeNet6D / REAL275 / Toyota-Light
指标:BOP Average Recall / VSD / MSSD / MSPD / ADD(S)-0.1d / mask mIoU
单位:Fondazione Bruno Kessler / University of Trento / Queen Mary University of London / Idiap Research Institute / EPFL
Robust Category-Level 3D Pose Estimation From Diffusion-Enhanced Synthetic Data
P3D-Diffusion 由 renderer 固定类别级 3D rotation label,再以 Canny-edge-conditioned diffusion、DTD 纹理先验和类别无关随机背景增强外观;CC3D 用 neural-mesh vertex correspondence 将合成特征适配到无标签真实图。PASCAL3D+ 上,使用 10% 真实 rotation labels 时达到 30° / 10° accuracy 86.7 / 62.4、MedErr 8.4°,50% labels 时为 90.7 / 71.4 / 6.9°;但它不估计 translation / scale,扩散输出的 pose-label drift 也未被直接量化。
Jiahao Yang, Wufei Ma, Angtian Wang, Xiaoding Yuan, Alan Yuille, Adam Kortylewski
方向:物体位姿估计
数据集:PASCAL3D+ / OOD-CV / P3D-Diffusion synthetic dataset / Describable Texture Dataset
指标:rotation accuracy below 30 degrees / rotation accuracy below 10 degrees / median angular error / OOD nuisance-wise rotation accuracy
单位:Peking University / Johns Hopkins University / University of Freiburg / Max Planck Institute for Informatics
PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environments
PACE 提供 300 段真实杂乱视频、55K 帧和 258K pose 标注,覆盖 238 个对象、43 类及刚体 / 关节物体,另有 100K 帧 PACE-Sim。PPF 在已知实例上达 52.2 BOP AR,而学习方法仅 4.4–9.0;受控实验进一步区分了 sim-to-real 与全对象规模化造成的两类性能断崖。
Yang You, Kai Xiong, Zhening Yang, Zhengxiang Huang, Junwei Zhou, Ruoxi Shi, Zhou Fang, Adam W. Harley, Leonidas Guibas, Cewu Lu
方向:物体位姿估计
数据集:PACE / PACE-Sim / NOCS-REAL275
指标:BOP Average Recall / VSD / MSSD / MSPD / 3D IoU AP / angle-threshold AP / translation-threshold AP / ADD AUC / ADD-S AUC / 5°5cm tracking accuracy
单位:Stanford University / Shanghai Jiao Tong University / Horizon Robotics / UC San Diego
PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DoF Object Pose Dataset Generation
PEGASUS 将对象和环境分别表示为负责外观的 3D Gaussians 与负责碰撞的低模 mesh,利用 PyBullet 生成自然刚体轨迹,再渲染并导出 BOP 格式 RGB、depth、mask、框与 6DoF pose。
Lukas Meyer, Floris Erich, Yusuke Yoshiyasu, Marc Stamminger, Noriaki Ando, Yukiyasu Domae
方向:3D 表示 / 重建
数据集:Ramen / PEGASet / YCB-V assets / PEGASUS-generated BOP datasets
指标:dataset generation time / robotic picking success
单位:Friedrich-Alexander-Universität Erlangen-Nürnberg / National Institute of Advanced Industrial Science and Technology
Physics-Based Rigid Body Object Tracking and Friction Filtering From RGB-D Videos
方法以可微刚体仿真作为 Extended Kalman Filter 的状态转移,在 RGB-D pose measurement 之间联合跟踪 position、SO(3) rotation、速度与摩擦系数。
Rama Krishna Prasad Kandukuri, Michael Strecke, Joerg Stueckler
方向:世界模型
数据集:Synthetic sliding and collision sequences / Real RGB-D sliding sequences / YCB object models
指标:rotation error / recall / position error / recall / linear / angular velocity error / friction coefficient error
单位:Embodied Vision Group, Max Planck Institute for Intelligent Systems
Shape-guided Configuration-aware Learning for Endoscopic-image-based Pose Estimation of Flexible Robotic Instruments
PoseFlex 以分部件 3D shape prior 通过 attention 引导内窥镜 RGB features,再由初始四角度构型生成动态 prior 做 refinement,并以 matrix-Fisher 输出角度与不确定性。12,473 对私有 ex-vivo 数据上,G3 的 α/β/γ/δ mean error 为 7.08°/4.66°/1.62°/11.68°;它不预测标准 6DoF translation。
Yiyao Ma, Kai Chen, Hon-Sing Tong, Ruofeng Wei, Yui-Lun Ng, Ka-Wai Kwok, Qi Dou
方向:物体位姿估计
数据集:PoseFlex ex-vivo flexible-robot dataset
指标:mean angular error / median angular error / accuracy below 5° / accuracy below 10° / matrix-Fisher uncertainty
单位:The Chinese University of Hong Kong / Agilis Robotics Limited / The University of Hong Kong
PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking
PS6D 以注意力点云特征、对称感知旋转损失和中心距离加权平移损失逐点预测 pose,并用先按中心、再按旋转的两阶段聚类分开交叉细长件与多对称模式;论文还报告单类工件 91.7% 真实 bin-picking 成功率。
Yifan Yang, Zhihao Cui, Qianyi Zhang, Jingtai Liu
方向:物体位姿估计
数据集:Siléane / IPA Bin-Picking Dataset / PS6D industrial dataset / Real Mech-Eye / Fanuc bin-picking trials
指标:instance F1 / Recall / bin-picking success rate
单位:Nankai University / Mech-Mind
RelPose++: Recovering 6D Poses from Sparse-view Observations
RelPose++ 用多视图 Transformer 更新 pairwise rotation energy distributions,并在 look-at-centered 坐标系下回归 translation,从稀疏对象视图恢复一致的相机组 6D pose。
Amy Lin, Jason Y. Zhang, Deva Ramanan, Shubham Tulsiani
方向:视觉定位 / SLAM
数据集:CO3D v2 / Objectron
指标:joint rotation Acc@15° / camera center Acc@0.2 / translation Acc@0.1
单位:Carnegie Mellon University
RGBManip: Monocular Image-Based Robotic Manipulation Through Active Object Pose Estimation
RGBManip 用高层 RL 策略调度主动观察与操作,以运动学引导的多视图 depth-aware features 估计类别级 pose,并用 impedance control 吸收残余误差;主要结果是六项机器人任务成功率而非独立 pose benchmark。
Boshi An, Yiran Geng, Kai Chen, Xiaoqi Li, Qi Dou, Hao Dong
方向:机器人感知与操作
数据集:PartNet-Mobility / ShapeNet / SAPIEN manipulation benchmark
指标:manipulation success rate / pose error versus number of views
单位:Peking University / Beijing Academy of Artificial Intelligence / The Chinese University of Hong Kong
Pseudo-keypoint RKHS Learning for Self-supervised 6DoF Pose Estimation
RKHSPose 先在 PBR 合成 RGB-D 上学习径向关键点回归 / CNN 投票,再以真实图像 pseudo-pose 生成 synthetic-over-real 配对,用可学习 RKHS kernel 的稠密 MMD 对齐多层特征。320 幅无标签真实图像使 LM-O ADD(S) 从 55.7 提至 68.7;方法仍需已知 CAD、闭集对象与逐目标域适配。
Yangzheng Wu, Michael Greenspan
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD / YCB-Video / T-LESS / TUD-L / ITODD / HomebrewedDB
指标:ADD(S) / ADD(S) AUC / ADD-S AUC / BOP Average Recall / VSD / MSSD / MSPD / inference time
单位:Queen’s University
SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation
面向训练未见实例的 RGB-D 零样本 6D pose:以目标 CAD 渲染模板作为物体先验,SAM/FastSAM 产生候选 mask,经 DINOv2 语义、外观和几何评分筛选,再用带 background tokens 的粗到细 3D-3D 对应与加权 SVD 输出所有目标实例的位姿。
Jiehong Lin, Lihua Liu, Dekun Lu, Kui Jia
方向:物体位姿估计
数据集:BOP core datasets / LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HB / YCB-V
指标:segmentation mAP (IoU 0.50-0.95) / BOP AR (VSD/MSSD/MSPD) / ADD(-S)
单位:DexForce Co., Ltd. / The Chinese University of Hong Kong, Shenzhen / South China University of Technology
Scalable Network and Adaptive Refinement Module for 6D Pose Estimation of Diverse Industrial Components
以 EfficientNet 和浅层双向 FPN 从 RGB 估计初始位姿,再利用观测深度进行自适应点云配准精修;网络规模与精修预算共享缩放参数,按收敛条件停止。
Kun Qian, Mustafa Suphi Erden, Xianwen Kong
方向:物体位姿估计
数据集:LINEMOD / Solar cell industrial dataset / Primary lens industrial dataset
指标:ADD(-S) / 5°1cm accuracy / FPS / refinement iterations
单位:University of Manchester / Heriot-Watt University
SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation in Bin-Picking Scenarios
SD-Net 按对象对称类型设计等价关键点集合,以逐点回归、实例聚类、关键点过滤和 Hough voting 恢复堆叠零件 pose,再通过 teacher–student 与 Semi-Chamfer 几何筛选把合成模型适配到无标注真实点云。
Ding-Tao Huang, En-Te Lin, Lipeng Chen, Li-Fu Liu, Long Zeng
方向:物体位姿估计
数据集:Siléane / Parametric dataset / Real Fanuc bin-picking trials
指标:symmetry-aware Average Precision / robotic grasping success
单位:Tsinghua Shenzhen International Graduate School / Tencent Robotics X
Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)
该方法直接学习条件分布 p(R,t|I),把 score diffusion 定义在 SE(3) 而非把旋转和平移独立扩散,并用 surrogate Stein score 避开昂贵 Jacobian。T-LESS 上 SE(3) 模型的 MSPD / R@5 为 93.16 / 86.94;100 步为 20 FPS,5 步仍有 250 FPS。
Tsu-Ching Hsiao, Hao-Wei Chen, Hsuan-Kung Yang, Chun-Yi Lee
方向:物体位姿估计
数据集:SYMSOL / SYMSOL-T / T-LESS
指标:distribution spread / MSPD / MSSD / VSD / R@2 / R@5 / R@10 / T@2 / T@5 / T@10 / FPS
单位:Elsa Lab, National Tsing Hua University
SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation
SecondPose 把 DINOv2 类别语义与分层 PPF 的实例几何逐点融合为近似 SE(3)-一致表示,再分别回归旋转、平移与尺寸。REAL275 达 IoU75 / 5°2cm 49.7 / 56.2,HouseCat6D IoU25/50 为 83.7/66.1;去掉语义后严格 5°2cm 降至 51.1。
Yamei Chen, Yan Di, Guangyao Zhai, Fabian Manhardt, Chenyangguang Zhang, Ruida Zhang, Federico Tombari, Nassir Navab, Benjamin Busam
方向:物体位姿估计
数据集:NOCS-REAL275 / NOCS-CAMERA25 / HouseCat6D
指标:3D IoU75 mAP / 5°2cm / 5°5cm / 10°2cm / 10°5cm / HouseCat6D IoU25 / IoU50 / FPS
单位:Technical University of Munich / Munich Center for Machine Learning / Google / Tsinghua University / 3dwe.ai
Sim-to-Real Object Pose Estimation for Random Bin Picking
该方法用目标 CAD 和 physics simulator 自动生成随机堆叠、实例分割与 pose annotations,只在 synthetic point clouds 上训练并无额外域适配地部署到真实料箱,最后接入机器人 picking 闭环;公开摘要报告 synthetic recall / accuracy 具有竞争力并提升真实抓取成功率,但未披露数值。
Boyoung Kim, Junhong Min
方向:物体位姿估计
数据集:Physics-simulated random-bin point clouds / Real robot bin-picking trials
指标:segmentation recall / pose accuracy / robot picking success rate
单位:
Single-Shot 6DoF Pose and 3D Size Estimation for Robotic Strawberry Harvesting
方法把单阶段 RGB detector 扩展为草莓 6DoF pose、3D size 与 confidence 联合回归,在 Ignition Gazebo 自动生成 Straw6D,并以 12 个绕主轴等价旋转处理近似对称;合成测试约 60 FPS。
Lun Li, Hamidreza Kasaei
方向:物体位姿估计
数据集:Straw6D / StrawDI
指标:3D IoU Average Precision / rotation-translation threshold AP / inference time
单位:University of Groningen
SUP-NeRF: A Streamlined Unification of Pose Estimation and NeRF for Monocular 3D Object Reconstruction
SUP-NeRF 先预测并固定 car dimensions,再以 projected-box state 做三次 learned pose refinement,随后接 object-centric NeRF,阻断单目 scale–depth ambiguity。nuScenes 为 7.01°/0.68m、KITTI zero-shot 为 6.79°/1.06m;50 次 NeRF optimization 需 1.493s 且不改善 pose,Waymo rotation 也低于 FCOS3D。
Yuliang Guo, Abhinav Kumar, Cheng Zhao, Ruoyu Wang, Xinyu Huang, Liu Ren
方向:物体位姿估计
数据集:nuScenes / KITTI / Waymo Open Dataset
指标:rotation error / translation error / PSNR / depth error / cross-view PSNR / cross-view depth error / runtime / parameter count
单位:Bosch Research North America / Bosch Center for Artificial Intelligence / Michigan State University
Learning Distributional Demonstration Spaces for Task-Specific Cross-Pose Estimation
TAX-PoseD 把 cVAE latent 表示为 point cloud 上的 categorical spatial distribution,使多个有效 relative placements 不再被平均成无效 pose;只用少量示范即可从 2-rack 训练泛化到 3-rack 场景。
Jenny Wang, Octavian Donca, David Held
方向:机器人感知与操作
数据集:NDF mug placement / PyBullet multi-rack mug hanging
指标:placement success rate / relative rotation error / relative translation error
单位:Carnegie Mellon University
ToolEENet: Tool Affordance 6D Pose Estimation
ToolEENet 将机器人所需状态从整件工具 pose 改为接触功能端 pose:Mask R-CNN 和深度提取 EE 点云,score-based diffusion 生成类别级 6D pose,并预测各轴对称属性处理不可观测旋转。
Yunlong Wang, Lei Zhang, Yuyang Tu, Hui Zhang, Kaixin Bai, Zhaopeng Chen, Jianwei Zhang
方向:机器人感知与操作
数据集:TOOLEE
指标:5°2cm accuracy / 5°5cm accuracy / 10°5cm accuracy / affordance segmentation mAP
单位:Universität Hamburg / Agile Robots AG
U-COPE: Taking a Further Step to Universal 9D Category-level Object Pose Estimation
U-COPE 把刚体建模为 K=1 的特殊关节物体,以 PointNet++、part-mask feature re-modulation 和同部件 PPF voting 联合输出 joint、segmentation 与逐部件 9D pose。CAMERA25 的 3D75+5° 为 57.3;ArtImage 默认 20K point pairs、约 1.4–2.1 s,真实 ReArtMix / RobotArm 仅给定性验证。
Li Zhang, Weiqing Meng, Yan Zhong, Bin Kong, Mingliang Xu, Jianming Du, Xue Wang, Rujing Wang, Liu Liu
方向:物体位姿估计
数据集:CAMERA25 / ArtImage / ReArtMix / RobotArm
指标:3D IoU mAP / joint rotation / translation threshold mAP / per-part rotation error / per-part translation error / per-part 3D IoU / inference time
单位:Hefei Institutes of Physical Science, Chinese Academy of Sciences / University of Science and Technology of China / Anhui University / Peking University / Astribot / Hefei University of Technology
Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos
该方法先用 SfM 粗 mesh 与 DINOv2 表面特征,在无姿态标签下把同类对象视频对齐到规范系,再训练神经 mesh 的像素—顶点对应并以 render-and-compare 解单图旋转。CO3D 对齐 Acc30 为 77.0;PASCAL3D+ / ObjectNet3D 单图 Acc30 为 69.2 / 52.4,单样本约 0.22 s。
Leonhard Sommer, Artur Jesslen, Eddy Ilg, Adam Kortylewski
方向:物体位姿估计
数据集:CO3D / PASCAL3D+ / ObjectNet3D
指标:30° rotation accuracy / 15° rotation accuracy / mean angular error / per-sample runtime
单位:University of Freiburg / Saarland University
YOLO-6D-Pose: Enhancing YOLO for Single-Stage Monocular Multi-Object 6D Pose Estimation
YOLO-6D-Pose 在 YOLOX 检测头旁直接回归连续 6D rotation representation 与 translation,以一次前向完成多对象检测和 pose,省去 keypoint、PnP 与迭代 refinement。
Debapriya Maji, Soyeb N. Nagori, Manu Mathew, Deepak Poddar
方向:物体位姿估计
数据集:YCB-Video / LM-Occlusion
指标:ADD(-S) / ADD(-S) AUC
单位:Texas Instruments India
Zero123-6D: Zero-Shot Novel View Synthesis for RGB Category-Level 6D Pose Estimation
Zero123-6D 用预训练扩散模型扩增稀疏 reference viewpoints,DINO 跨实例语义匹配提供 coarse pose,再由离线 NeUS 几何构造 2D–3D 对应并在线优化,实现无 query/reference depth 的类别级 pose。
Francesco Di Felice, Alberto Remus, Stefano Gasperini, Benjamin Busam, Lionel Ott, Federico Tombari, Roland Siegwart, Carlo Alberto Avizzano
方向:物体位姿估计
数据集:CO3D / Objectron
指标:median rotation error / rotation accuracy at 15° / rotation accuracy at 30° / online optimization time
单位:Scuola Superiore Sant’Anna / Technical University of Munich / ETH Zurich / Google Zurich
ZS6D: Zero-Shot 6D Object Pose Estimation Using Vision Transformers
ZS6D 用自监督 ViT 的全局 token 检索最接近的 CAD 渲染视角,再以局部 token 建立 2D–3D 对应并用 RANSAC-PnP 求 pose;无需 pose-specific fine-tuning,重点验证预训练视觉特征对未见 CAD 对象的几何泛化。
Philipp Ausserlechner, David Haberger, Stefan Thalhammer, Jean-Baptiste Weibel, Markus Vincze
方向:物体位姿估计
数据集:LM-Occlusion / YCB-Video / T-LESS / BOP
指标:BOP Average Recall / VSD / MSSD / MSPD
单位:TU Wien / AIT Austrian Institute of Technology
CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation
把多个物体实例表示为空间中心,在单次前向中同时预测 3D shape、6D pose 和 size,面向无 CAD 的类别级多物体场景。
Muhammad Zubair Irshad, Thomas Kollar, Michael Laskey, Kevin Stone, Zsolt Kira
方向:物体位姿估计
数据集:ShapeNet / NOCS / REAL275
指标:3D IoU / mAP / 5° 5cm
单位:Georgia Institute of Technology / Toyota Research Institute
Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images
面向未见实例的 CAD-free RGB 6D pose:以带位姿参考图为唯一物体先验,先相关检测,再用全局归一化与 reference-view transformer 选视角,最后在参考特征构建的 3D volume 中迭代细化位姿。
Yuan Liu, Yilin Wen, Sida Peng, Cheng Lin, Xiaoxiao Long, Taku Komura, Wenping Wang
方向:物体位姿估计
数据集:GenMOP / MOPED / LINEMOD
指标:ADD-0.1d / ADD-AUC / Prj-5
单位:The University of Hong Kong / Zhejiang University / Tencent / Texas A&M University
MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare
MegaPose 用 2M 张、超过 20K 个训练物体的合成图像学习 category-agnostic render-and-compare:coarse network 对 520 个 CAD pose hypotheses 判断其是否落入 refiner 收敛域,refiner 再以四视角 RGB / depth / normal renderings 迭代更新测试未见实例的 6D pose;测试时无需针对目标物体重训,但必须给定带尺度 CAD、相机内参和目标 ROI。
Yann Labbé, Lucas Manuelli, Arsalan Mousavian, Stephen Tyree, Stan Birchfield, Jonathan Tremblay, Justin Carpentier, Mathieu Aubry, Dieter Fox, Josef Sivic
方向:物体位姿估计
数据集:LM-O / T-LESS / TUD-L / IC-BIN / ITODD / HomebrewedDB / YCB-Video / ModelNet / ShapeNet / Google Scanned Objects
指标:BOP AR (VSD/MSSD/MSPD) / 5°/5cm recall / ADD-0.1d / Proj2D@5px
单位:ENS / Inria / NVIDIA / LIGM / Ecole des Ponts / University of Washington / CIIRC CTU
MV6D: Multi-View 6D Pose Estimation on RGB-D Frames Using a Deep Point-wise Voting Network
把 PVN3D 思路扩展到多视角 RGB-D 输入,融合多视角点云与图像特征,直接预测杂乱场景中所有物体的 6D 位姿。
Fabian Duffhauss, Tobias Demmler, Gerhard Neumann
方向:物体位姿估计
数据集:YCB-Video / cluttered multi-view RGB-D datasets
指标:ADD / ADD-S
单位:Karlsruhe Institute of Technology
PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Tracking
PIZZA 在只给首帧目标框的 RGB 视频中,以 unseen-object segmentation 和 RAFT 持续生成共享 crop,再由双帧 CNN 或多帧 Transformer 回归连续帧间的轴角旋转、像平面位移与相对深度变化;测试对象无需 CAD、depth、参考图或专属训练,但没有首帧度量 pose 时只能恢复相对第一帧、带全局旋转与尺度不确定性的 6D motion trajectory。
Van Nguyen Nguyen, Yuming Du, Yang Xiao, Michaël Ramamonjisoa, Vincent Lepetit
方向:物体位姿估计
数据集:ModelNet / ShapeNet / BOP synthetic data / Laval / MOPED
指标:5°/5cm recall / ADD-0.1d / ADD-S AUC / Proj2D-5px / rotation error / translation error
单位:LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, France
YOLOPose: Transformer-based Multi-Object 6D Pose Estimation using Keypoint Regression
用 Transformer 做联合检测和关键点回归,目标是在单阶段架构里端到端输出多个物体的检测结果与 6D 位姿。
Arash Amini, Arul Selvam Periyasamy, Sven Behnke
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD
指标:ADD / ADD-S / 2D Projection
单位:University of Bonn
FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimation
在 RGB 与点云两个分支的全流程中做双向融合,并选择 3D keypoints 输出姿态,强化 RGB-D 多物体场景中的外观和几何互补。
Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, Jian Sun
方向:物体位姿估计
数据集:YCB-Video / LINEMOD
指标:ADD / ADD-S
单位:Megvii Technology / HKUST
GDR-Net: Geometry-Guided Direct Regression Network for Monocular 6D Object Pose Estimation
结合几何引导的中间表示和直接姿态回归,在单目 RGB 位姿估计中兼顾端到端预测和几何约束。
Gu Wang, Fabian Manhardt, Federico Tombari, Xiangyang Ji
方向:物体位姿估计
数据集:LINEMOD / YCB-Video / T-LESS / BOP
指标:ADD / ADD-S / VSD / MSSD / MSPD / AR
单位:Tsinghua University / Technical University of Munich / Google
CosyPose: Consistent Multi-view Multi-object 6D Pose Estimation
面向多物体和多视角一致性建模,强调从检测、单视角估计到多视角联合优化的完整系统。
Yann Labbé, Justin Carpentier, Mathieu Aubry, Josef Sivic
方向:物体位姿估计
数据集:YCB-Video / T-LESS / BOP
指标:ADD-S / VSD / MSSD / MSPD / AR
单位:INRIA / École des Ponts ParisTech / CIIRC CTU
EPOS: Estimating 6D Pose of Objects with Symmetries
用 surface fragments 表达对称物体,在像素级预测对象存在概率、fragment 概率和 3D 位置,再为可能的多个实例运行 PnP-RANSAC。
Tomas Hodan, Daniel Barath, Jiri Matas
方向:物体位姿估计
数据集:T-LESS / Occlusion LINEMOD / YCB-Video / BOP
指标:VSD / MSSD / MSPD / AR
单位:Czech Technical University in Prague
PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimation
在点云上做逐点 3D keypoint Hough voting,再用最小二乘拟合姿态,适合 RGB-D 多物体场景中的遮挡和杂乱条件。
Yisheng He, Wei Sun, Haibin Huang, Jianran Liu, Haoqiang Fan, Jian Sun
方向:物体位姿估计
数据集:YCB-Video / LINEMOD
指标:ADD / ADD-S
单位:Megvii Technology / Tsinghua University
DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
融合 RGB 外观特征和点云几何特征,并通过迭代 refinement 提升 RGB-D 位姿估计精度。
Chen Wang, Danfei Xu, Yuke Zhu, Roberto Martin-Martin, Cewu Lu, Li Fei-Fei, Silvio Savarese
方向:物体位姿估计
数据集:YCB-Video / LINEMOD
指标:ADD / ADD-S
单位:Stanford University / Shanghai Jiao Tong University
DPOD: 6D Pose Object Detector and Refiner
预测多类别 dense correspondence map,再用 PnP/RANSAC 和 RGB refinement 生成多个物体的 6D 姿态,是 RGB dense 对应路线的代表。
Sergey Zakharov, Ivan Shugurov, Slobodan Ilic
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD
指标:ADD / ADD-S / 2D Projection
单位:Technical University of Munich / Siemens
Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation
提出 normalized object coordinate space,把不同实例映射到类别共享规范空间,可在杂乱 RGB-D 场景中估计多个未见实例的位姿和尺寸。
He Wang, Srinath Sridhar, Jingwei Huang, Julien Valentin, Shuran Song, Leonidas J. Guibas
方向:物体位姿估计
数据集:CAMERA25 / REAL275 / NOCS
指标:3D IoU / mAP / 5° 5cm
单位:Stanford University / Google
PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation
通过像素级方向投票定位 2D 关键点,再结合 PnP 求解姿态,提升了遮挡场景下关键点定位的稳定性。
Sida Peng, Yuan Liu, Qixing Huang, Xiaowei Zhou, Hujun Bao
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD
指标:ADD / ADD-S / 2D Projection
单位:Zhejiang University
Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objects
使用合成数据训练 RGB 关键点/向量场网络,在机器人抓取场景中实时输出多个已知 household object 的 6D 位姿。
Jonathan Tremblay, Thang To, Balakumar Sundaralingam, Yu Xiang, Dieter Fox, Stan Birchfield
方向:物体位姿估计
数据集:YCB-Video / YCB-Object
指标:ADD / ADD-S / 2D Projection
单位:NVIDIA / University of Washington
PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
将语义分割、平移估计和旋转回归结合起来,是 YCB-Video 数据集和早期深度学习 6D pose 方法中的代表工作。
Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, Dieter Fox
方向:物体位姿估计
数据集:YCB-Video / LINEMOD
指标:ADD-S / 2D Projection
单位:University of Washington / NVIDIA
Real-Time Seamless Single Shot 6D Object Pose Prediction
YOLO 风格单阶段网络同时检测物体并回归 3D 包围盒顶点投影,再用 PnP 求姿态,强调实时多物体推理。
Bugra Tekin, Sudipta N. Sinha, Pascal Fua
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD
指标:ADD / ADD-S / 2D Projection
单位:EPFL / Microsoft
SSD-6D: Making RGB-based 3D Detection and 6D Pose Estimation Great Again
把 SSD 检测框架扩展到 3D model instance detection 和 6D pose space,用单张 RGB 图像直接产生多个物体的姿态假设。
Wadim Kehl, Fabian Manhardt, Federico Tombari, Slobodan Ilic, Nassir Navab
方向:物体位姿估计
数据集:LINEMOD / Occlusion LINEMOD
指标:ADD / ADD-S / 2D Projection
单位:Technical University of Munich / Siemens