Event
Paper on language-driven semantic navigation framework released
1 reports · 1 sources
Jose Martínez-Fajardo and co-authors have released a paper on a language-driven semantic navigation framework for mobile robots. The framework enables robots to understand natural-language requests such as "go to the mailbox," identify the referenced object, estimate its position using RGB-D data, and generate a navigation goal that is then executed by the ROS 2 Nav2 navigation stack. The authors state that the system has been tested in simulation and real-world scenarios, using a TurtleBot3 Waffle equipped with a RealSense camera and a Unitree Go2 robot; the code will be open-sourced after the paper is accepted.
Report timeline
- From Language to Navigation Goals: A Vision-Language Approach for Semantic Navigation of Mobile Robots Using RGB-D Perception
The study proposes a language-driven navigation framework that enables mobile robots to understand natural-language requests such as "go to the mailbox," identify the referenced object, estimate its position using RGB-D data, and generate a navigation goal that is then executed by the ROS 2 Nav2 navigation stack.
arXiv cs.RO ·