ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning
Year: 2024
Type: article
Abstract: Transparent objects are ubiquitous in daily life, making their perception and robotics manipulation important. However, they present a major challenge due to their distinct refractive and reflective properties when it comes to accurately estimating the 6D pose. To solve this, we presentReFlow6D, a novel method for transparent object 6D pose estimation that harnesses therefractive-intermediate representation. Unlike conventional approaches, our method leverages a feature space impervious to changes in RGB image space and independent of depth information. Drawing inspiration from image matting, we model the deformation of the light path through transparent objects, yielding a unique object-specific intermediate representation guided by light refraction that is independent of the environment in which objects are observed. By integrating these intermediate features into the pose estimation network, we show thatReFlow6Dachieves precise 6D pose estimation of transparent objects, using only RGB images as input. Our method further introduces a novel transparent object compositing loss, fostering the generation of superiorrefractive-intermediatefeatures. Empirical evaluations show that our approach significantly outperforms state-of-the-art methods onTODandTrans32K-6Ddatasets. Robot grasping experiments further demonstrate thatReFlow6D'spose estimation accuracy effectively translates to real-world robotics task.
Institutions: TU Wien, University of Applied Sciences Technikum Wien
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,495
Funder: European Commission
OpenAlex ID: W4402300309