Event
LightNav-0 Integrated into MuJoCo Simulation Demo for Closed-Loop VLN Navigation
2 reports · 1 sources
Reddit user /u/Hungry-Benefit6053 integrated the open-source vision-language navigation model LightNav-0 into the Microduck simulation in MuJoCo, and later into a digital twin of the DM-H65 two-wheel differential robot. The robot receives instructions such as "find the refrigerator in the room and stop next to it," predicts paths from first-person frames, and executes them via MPC and the official ONNX gait policy, realizing a navigation pipeline that takes instructions in and walks out. The latest demo's closed loop includes 17 model predictions, covering replanning and recovery when paths expire. The entire system runs local real-time inference on a Jetson AGX Orin 32GB (with a Seeed reComputer Robotics J501 carrier board) without relying on the cloud. The author emphasized twice that this is only a simulation demo and not a verified navigation success; rigorous benchmarking is still ongoing. The demo is part of their open-source mobile robotics course.
Developments
- MuJoCo vision-language navigation simulation demo of LightNav-0 on Jetson AGX Orin · 1 reports
- Open-source vision-language-action navigation model LightNav-0 integrated into Microduck MuJoCo simulation: instruction in, walking out on Jetson edge devices · 1 reports
Report timeline
- MuJoCo vision-language navigation simulation demo of LightNav-0 on Jetson AGX Orin
A MuJoCo digital-twin simulation demo connects the open-source vision-language navigation model LightNav-0 to a DM-H65 two-wheel differential robot, with the goal of "finding the refrigerator in the room and stopping next to it." It runs entirely locally on a Jetson AGX Orin 32GB (Seeed reComputer Robotics J501), and the closed loop includes 17 model predictions, covering replanning and recovery when the path expires.
Reddit r/robotics ·
- Open-source vision-language-action navigation model LightNav-0 integrated into Microduck MuJoCo simulation: instruction in, walking out on Jetson edge devices
The author integrated the open-source vision-language navigation model LightNav-0 into the Microduck simulation (MuJoCo). The robot receives instructions such as "walk to the wooden door frame and stop," predicts a path from first-person frames, and executes it via MPC and the official ONNX gait policy.
Reddit r/robotics ·