Real-time object navigation with deep neural networks and hierarchical reinforcement learning

Aleksey Staroverov, Dmitry A. Yudin, Ilya Belkin, Vasily Adeshkin, Yaroslav K. Solomentsev, Aleksandr I. Panov

Результат исследований: Вклад в журналСтатьярецензирование

17 Цитирования (Scopus)


In the last years, deep learning and reinforcement learning methods have significantly improved mobile robots in such fields as perception, navigation, and planning. But there are still gaps in applying these methods to real robots due to the low computational efficiency of recent neural network architectures and their poor adaptability to robotic experiments’ realities. In this article, we consider an important task in mobile robotics - navigation to an object using an RGB-D camera. We develop a new neural network framework for robot control that is fast and resistant to possible noise in sensors and actuators. We propose an original integration of semantic segmentation, mapping, localization, and reinforcement learning methods to improve the effectiveness of exploring the environment, finding the desired object, and quickly navigating to it. We created a new HISNav dataset based on the Habitat virtual environment, which allowed us to use simulation experiments to pre-train the model and then upload it to a real robot. Our architecture is adapted to work in a real-time environment and fully implements modern trends in this area.

Язык оригиналаАнглийский
Номер статьи3034524
Страницы (с-по)195608-195621
Число страниц14
ЖурналIEEE Access
СостояниеОпубликовано - 2020
Опубликовано для внешнего пользованияДа


Подробные сведения о темах исследования «Real-time object navigation with deep neural networks and hierarchical reinforcement learning». Вместе они формируют уникальный семантический отпечаток (fingerprint).