NVIDIA Releases Cosmos3-H-Dreams Real-Time Surgical World Model

NVIDIA released Cosmos3-H-Dreams on October 20, 2026, a real-time, action-conditioned generative world model for robotic surgery fine-tuned on clinical cholecystectomy recordings from the CMR Surgical Versius system. The model checkpoint and companion code were published the same day. In an NVIDIA-authored announcement on Hugging Face, the company said that, to its knowledge, Cosmos3-H-Dreams is the first real-time generative surgical simulator trained on clinical cholecystectomy recordings to support live kinematic control.

Powered by Cosmos 3 and accelerated with FlashDreams, NVIDIA’s streaming-inference library, the model runs interactively on a single NVIDIA RTX PRO 6000 GPU, according to the announcement. The model card lists release dates of October 20, 2026 on both GitHub and Hugging Face and states the model is ready for commercial or non-commercial use under the NVIDIA Open Model License.

It names surgical robotics policy evaluation in simulation, interactive teleoperated world-model exploration, and synthetic data generation for robotic cholecystectomy as intended uses, aimed at surgical robotics researchers, healthcare AI developers, academic institutions, and surgical robotics companies. Cosmos3-H-Dreams succeeds Cosmos-H-Dreams, a model built on Cosmos-Predict2.5 that targeted dVRK tabletop suturing. As…