Enhanced Human-Robot Collaboration through AI Tools and Collision Avoidance Control
Year: 2024
Type: conference-paper
Abstract: Due to the spread of collaborative robotics, humanrobot collaboration is becoming more and more common in industrial environments. However, there is a need to make this interaction increasingly usable for the operator and less tiring by making the robot adapt to the operator’s needs. In this paper, a framework based on Deep Learning techniques is presented that enables the operator to perform an manufacturing task assisted by a collaborative robot in a safer, less tiring and more flexible way. Three RGB-D cameras are used to capture information about the environment in which the human is working and about the human position. The framework has three main components: gesture recognition, robotic grasping and collision avoidance. Specifically, a Convolutional Neural Network has been implemented for gesture classification. Through gestures, the operator tells the robot what tool is needed for that subtask and the robot provides it. At the end of the machining process, through an automatic grasping pose detection, the robot is able to pick up the tool on its own at the position where the operator left it. During the interaction with the robot and the sharing of the workspace, the safety of the operator is ensured by avoiding collision with the robot. The safety distance between human and robot is always respected. Results of testing the framework on a real user-case using the Universal Robot 5e robot are presented. Code, videos and data are available at https://github.com/matteoforlini/human_robot_assembly_task
Institution: Marche Polytechnic University
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4403277006