lab Hugging Face Blog · 11h ago · releases

NVIDIA releases Cosmos 3 Edge, a 4B-parameter model for real-time robot control on edge devices

from English

NVIDIA has released Cosmos 3 Edge, a 4-billion-parameter open world model designed to deliver data center-level performance on memory-constrained edge systems. The model enables robots and vision AI agents to understand their surroundings, reason in real time, and generate actions directly on devices such as NVIDIA Jetson modules.

Cosmos 3 Edge operates at robot-control resolution (640×360) and generates 32 actions per inference while achieving real-time control at 15 Hz on NVIDIA Jetson Thor.
It ranks #1 among similar size models on VANTAGE-Bench for vision analytics and sets the state of the art for robot policy learning.
The architecture combines an autoregressive tower for reasoning with a diffusion tower for prediction, sharing multimodal attention layers to align language, video, audio, and action tokens.
NVIDIA also released Cosmos 3 Edge Policy (DROID) post-trained on the DROID dataset for pick-and-place tasks, along with reference checkpoints and training scripts.

The release allows developers to deploy models closer to sensors on-device, using open frameworks to customize and specialize the model for specific physical AI applications.

Importance 2/3 Trust 1/3 Hugging Face Blog NVIDIA Open weights Robotics

Related articles

arxiv arXiv cs.LG · 4d ago

RoboTTT scales robot policies to 8K-timestep context

Researchers introduce RoboTTT, a training recipe that extends visuomotor context for robot foundation models to 8,000 timesteps without increasing inference latency. The method integrates Test-Time Training into Vision-Language-Action policies by using fast weights updated via gradient descent during both training and inference.

arxiv arXiv cs.AI · 4d ago

RoboTTT scales robot policies to 8K-timestep context

NVIDIA introduces RoboTTT, a robot foundation model and training recipe that extends visuomotor context to 8,000 timesteps without increasing inference latency. By integrating Test-Time Training into Vision-Language-Action policies, the system compresses history into weight space using fast weights updated by gradient descent.

lab Hugging Face Blog · 5d ago · 2 views

NVIDIA releases Nemotron 3 Embed models ranking #1 on RTEB

NVIDIA has released Nemotron 3 Embed, a collection of open and commercially available embedding models designed to improve retrieval quality for production-scale RAG, agentic retrieval, code retrieval, and agent memory. The collection features an 8B model that ranks #1 overall on the RTEB leaderboard, alongside efficient 1B variants optimized for deployment.

media r/LocalLLaMA · 7d ago

NVIDIA releases Nemotron-3-Embed 1B and 8B models

NVIDIA has released the Nemotron-3-Embed 1B and 8B text embedding models, optimized for retrieval and semantic similarity tasks. These models are designed to serve as foundational components in text-based Retrieval-Augmented Generation (RAG) systems.

lab NVIDIA Technical Blog · 9d ago

NVIDIA introduces method for evaluating general-purpose robot policies

NVIDIA addresses the challenge of rigorously evaluating robotics foundation models, which can now follow natural language instructions to manipulate objects. The company identifies evaluation as a critical unsolved problem and presents a new method to address these issues.