From 35c26c4c6582f4e9ea12b4ad285c7f760f64c588 Mon Sep 17 00:00:00 2001 From: Manuel Stoiber Date: Thu, 23 Feb 2023 07:58:22 +0100 Subject: [PATCH] feat(readme): add link to IROS preprint --- ICG+/readme.md | 3 ++- M3T/readme.md | 2 +- 2 files changed, 3 insertions(+), 2 deletions(-) diff --git a/ICG+/readme.md b/ICG+/readme.md index 1b1cf84..70ed6ae 100644 --- a/ICG+/readme.md +++ b/ICG+/readme.md @@ -3,7 +3,8 @@ ## Paper Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Tracking Manuel Stoiber, Mariam Elsayed, Anne E. Reichert, Florian Steidle, Dongheui Lee, Rudolph Triebel -Submitted to IEEE/RSJ International Conference on Intelligent Robots (IROS) 2023 +Submitted to IEEE/RSJ International Conference on Intelligent Robots (IROS) 2023 +[preprint](https://arxiv.org/pdf/2302.11458.pdf) ## Abstract In many applications of advanced robotic manipulation, six degrees of freedom (6DoF) object pose estimates are continuously required. In this work, we develop a multi-modality tracker that fuses information from visual appearance and geometry to estimate object poses. The algorithm extends our previous method ICG, which uses geometry, to additionally consider surface appearance. In general, object surfaces contain local characteristics from text, graphics, and patterns, as well as global differences from distinct materials and colors. To incorporate this visual information, two modalities are developed. For local characteristics, keypoint features are used to minimize distances between points from keyframes and the current image. For global differences, a novel region approach is developed that considers multiple regions on the object surface. In addition, it allows the modeling of external geometries. Experiments on the YCB-Video and OPT datasets demonstrate that our approach ICG+ performs best on both datasets, outperforming both conventional and deep learning-based methods. At the same time, the algorithm is highly efficient and runs at more than 300 Hz. The source code of our tracker is publicly available. diff --git a/M3T/readme.md b/M3T/readme.md index 29a38ec..58dac7a 100644 --- a/M3T/readme.md +++ b/M3T/readme.md @@ -298,7 +298,7 @@ More details can be found in the following publications: - **Fusing Visual Appearance and Geometry for Multi-Modality 6DoF Object Tracking** Manuel Stoiber, Mariam Elsayed, Anne E. Reichert, Florian Steidle, Dongheui Lee, and Rudolph Triebel - Submitted to IEEE/RSJ International Conference on Intelligent Robots 2023 + Submitted to IEEE/RSJ International Conference on Intelligent Robots 2023: [paper](https://arxiv.org/abs/2302.11458) - **Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objects** Manuel Stoiber, Martin Sundermeyer, and Rudolph Triebel