Work

A Modular Software Framework for Eye–Hand Coordination in Humanoid Robots

Year: 2016
Type: article
Abstract: We describe our software system enabling a tight integration between vision and control modules on complex, high-DOF humanoid robots. This is demonstrated with the iCub humanoid robot performing visual object detection, reaching and grasping actions. A key capability of this system is reactive avoidance of obstacle objects detected from the video stream while carrying out reach-and-grasp tasks. The subsystems of our architecture can independently be improved and updated, for example, we show that by using machine learning techniques we can improve visual perception by collecting images during the robot’s interaction with the environment. We describe the task and software design constraints that led to the layered modular system architecture.
Language: English
Open Access status: gold
Estimated APC paid: $2,353
OpenAlex ID: W2403087184
FWCI: 0.841
Cites: 72
Cited by: 6
Related to: 10