Visuo-Tactile Exploration of Unknown Rigid 3D Curvatures by Vision-Augmented Unified Force-Impedance Control
Year: 2024
Type: conference-paper
Abstract: Despite recent advancements in torque-controlled tactile robots, integrating them into manufacturing settings remains challenging, particularly in complex environments. Simplifying robotic skill programming for non-experts is crucial for increasing robot deployment in manufacturing. This work proposes an innovative approach, Vision-Augmented Unified Force-Impedance Control (VA-UFIC), aimed at intuitive visuo-tactile exploration of unknown 3D curvatures. VA-UFIC stands out by seamlessly integrating vision and tactile data, enabling the exploration of diverse contact shapes in three dimensions, including point contacts, flat contacts with concave and convex curvatures, and scenarios involving contact loss. A pivotal component of our method is a robust online contact alignment monitoring system that considers tactile error, local surface curvature, and orientation, facilitating adaptive adjustments of robot stiffness and force regulation during exploration. We introduce virtual energy tanks within the control framework to ensure safety and stability, effectively addressing inherent safety concerns in visuo-tactile exploration. Evaluation using a Franka Emika research robot demonstrates the efficacy of VA-UFIC in exploring unknown 3D curvatures while adhering to arbitrarily defined force-motion policies. By seamlessly integrating vision and tactile sensing, VA-UFIC offers a promising avenue for intuitive exploration of complex environments, with potential applications spanning manufacturing, inspection, and beyond.
Institution: Technical University of Munich
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
Awards: G1305463392, G1314256473, EXC 2050: Centre for Tactile Internet with HumanintheLoop (CeTI), G1407243695, G1933938177, G2342360367, Verbundprojekt: Digitale Transformation und Souveränität künftiger Kommunikationsnetze - 6G-life -, Teilvorhaben: Grundlagen und Systemlösungen für Post Shannon Kommunikation, In-Network Computing, eingebettete Sicherheit und Resilienz, G4021765181, G434337789, Self-reconfiguration of a robotic workcell for the recycling of electronic waste, G5154814024, G5628759018, G7472567491
OpenAlex ID: W4405786138