Year: 2024
Type: conference-paper
Abstract: This paper presents a novel approach to building mission planners based on neural networks with Transformer architecture and Large Language Models (LLMs). This approach demonstrates the possibility of setting a task for a mobile robot and its successful execution without the use of perception algorithms, based only on the data coming from the camera. In this work, a success rate of more than 50% was obtained for one of the basic actions for mobile robots. The proposed approach is of practical importance in the field of warehouse logistics robots, as in the future it may allow to eliminate the use of markings, LiDARs, beacons, and other tools for robot orientation in space. In conclusion, this approach can be scaled for any type of robot and for any number of robots.
Authors: Vladimir Berman, Artem Bazhenov, Sergei Satsevich, Dzmitry Tsetserukou
Institution: Skolkovo Institute of Science and Technology
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
Funder: Russian Science Foundation
Award: G2841149998
OpenAlex ID: W4406892426