NVIDIA open-sources Cosmos interactive world simulation framework
What happened
NVIDIA proposes a shared framework that adapts the Cosmos world foundation model into real-time interactive world simulation for Physical AI. The framework streams visual observations based on actions and scene control flow, and can both predict the visual consequences of actions and generate observations from physical states maintained by an external simulator. The authors demonstrate it in camera navigation, robotic manipulation, controllable video transfer, and multi-view autonomous driving simulation, and have released the code and model checkpoints.
AI 根据报道生成 · 6 days ago更新
Reporting timeline
Follow the reporting to explore different perspectives.
- arXiv cs.ROFeaturedNVIDIA proposes Cosmos-based interactive world simulation framework
NVIDIA proposes a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation for Physical AI. The framework can stream visual observations in response to actions and scene control flows, supporting both predicting the visual consequences of actions and generating observations from physical states maintained by an external simulator. The authors demonstrate it in camera navigation, robot manipulation, controllable video transfer, and multi-view autonomous driving simulation, and have released the code and model checkpoints.
Activity for this event
- Current
- 3
- Peak
- 10Nov 5 14:00
- Past 24 hours
- -49%
The trend compares participants observed throughout the same period, so its range may be smaller than the current interest count. Move or tap to inspect each hour; use the arrow keys on a keyboard.