AI product Open source

LightNav-0

LightNav-0 is an open-source generalist embodied-navigation model from the Light Origins Team. It uses a pretrained Qwen3-VL backbone with a single egocentric RGB stream and natural-language instructions to control humanoid, quadruped, wheeled, and aerial robots, transferring across tasks, embodiments, and scenes without per-task or per-benchmark fine-tuning.

View repository Mentioned in 2 videos ↓

Overview

The model extends the vocabulary with dual-channel pointing tokens and residual vector-quantized action tokens rather than adding navigation-specific prediction heads. At each step, it emits an affordance point representing a feasible local direction or waypoint and an object point representing the goal, followed by three action tokens that decode to ten future SE(2) waypoints for an embodiment-specific low-level controller. Its temporally aware history compressor samples older frames less frequently, pools them more coarsely, and preserves ordering with timestamp tokens while bounding the visual context.

The repository includes a released checkpoint and action decoder, command-line prediction, a vLLM-based server with WebSocket streaming, a MuJoCo simulation demo, evaluation harnesses, and a ROS 2 deployment stack with adapters for the Unitree Go2 and LimX TRON 1. The project is released under the Apache License 2.0; the included EVT-Bench is separately licensed CC BY-NC-SA 4.0.

What LightNav-0 is used for

2 uses taken from transcripts — each links to the moment in the video.

  • A navigation model that uses one RGB camera and can control humanoid, quadruped, wheeled, or flying robots without fine-tuning. It predicts feasible movement directions and target locations.

  • A compact generalist embodied-navigation model that drives different robots from spoken or written directions. It processes first-person camera frames and language instructions to produce spatial and action tokens, with support for humanoid, quadruped, wheeled, and aerial robots.

Videos mentioning LightNav-0

2 in the library.