Mistral AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Using a Single RGB Camera

AI Releases Robostral Navigate: An 8B Model Enabling Robots to Navigate Complex Environments Using a Single RGB Camera">

Mistral AI has released Robostral Navigate , its first model built for embodied navigation. The 8B model takes RGB images and a plain-language instruction, then moves a robot. Notably, it reaches 76.6% success on R2R-CE validation unseen using only a single RGB camera.

Robostral Navigate is an 8B model for robotic navigation through complex environments. These environments include offices, residential buildings, commercial buildings, and outdoor settings. You give it one instruction, and it completes the whole task alone. For example: ‘Leave the lobby, walk through the corridor, enter the supply room, and stop to face the second shelf. ‘ Importantly, it moves through live spaces full of people and obstacles never seen in training.

Moreover, most navigation systems use depth sensors, LiDAR, or several cameras together. By contrast, Robostral Navigate uses one ordinary RGB camera and no depth sensors. Fewer sensors also make the system more efficient than multi-sensor approaches.

Beyond hardware, the next question is how the model decides where to move. To choose each move, the model uses a method called pointing . Given a task and observation history, it predicts where the robot moves next. Specifically, it infers the image coordinates of the target in the current camera view. It also predicts the desired orientation upon arrival.

This choice has a clear benefit. Unlike commands based on metric displacements, pointing stays robust to camera-intrinsic and world-scale changes. However, pointing fails when the target sits outside the current field of view. In that case, the model falls back to displacements in the robot’s local coordinate frame. For example: ‘Move 2 meters forward, 1.5 meters to the left, and turn 25 degrees left. ‘

Notably, Robostral Navigate does not rely on existing open-source VLMs. Instead, it starts from Mistral’s vision-language model built for grounding tasks. Those tasks include pointing, counting, and object localization. Navigation then emerges as a natural extension of grounding. Once the model knows where things are, it learns how to move.

For training data, Mistral built a generation pipeline entirely in simulation. This pipeline produced roughly 400,000 trajectories collected across 6,000 scenes.

Beyond data, training efficiency was core element to the design. The method uses an algorithm based on prefix-caching. A tree-based attention-masking strategy compresses an entire episode into one sequence. Consequently, the model trains on all time steps in a single forward pass. It also prevents information leakage between time steps.